There are 4800 Henry Taylor deaths on FreeBMD so cannot even guess his death date.

2010: Found him on the 1851 census:

Name Relation Condition Sex Age Birth Year Occupation  Disability  Where Born

TAYLOR, Henry Head Married M 59 1792 Rector Of This Parish   Westallington, Devonshire
TAYLOR, Marianne Wife Married F 69 1782 Rector Wife  London
WEBBER, Joseph Servant Unmarried M 45 1806 Gardener  East Ogwell, Devonshire
PRESTON, Mary Ann Servant Unmarried F 26 1825 Lady's Maid  Lalworth, Dorset
NEITHERCOT, Harriet Servant Unmarried F 34 1817 Cook  Rewe, Devonshire
DARE, Mary Jane Servant Unmarried F 17 1834 House Maid  Charleton, Devonshire
JEFFERY, Ann Stone Servant Unmarried F 16 1835 Kitchen Maid  Stokenham, Devonshire

RG number: HO107 Piece: 1875 Folio: 224 Page: 21    

Registration District: Kingsbridge Sub District: Stokenham
EnumerationDistrict: 4 Ecclesiastical Parish:

Civil Parish: South Pool Municipal Borough:
Address: Rectory House, Village Of South Pool, South Pool
County: Devonshire
___________________

By the time of the 1861 census he was dead as his wife was a widow.

The following died in those ten years in Devon, apart from excluding the double forenamed people, I have no idea which might have been him, if any:

Surname First name(s) Age District Vol Page
Deaths Mar 1851   (>99%)
TAYLOR Henry Totnes 9 381   
Deaths Mar 1853   (99%)
TAYLOR Henry South Molton 5b [23]32   
Deaths Mar 1854   (>99%)
Taylor Henry Bideford 5b 364   
Deaths Dec 1854   (>99%)
Taylor Henry Exeter 5b 79   
Deaths Sep 1857   (>99%)
Taylor Henry Exeter 5b 59   
Deaths Mar 1858   (99%)
Taylor Henry Plymouth 5b 192   
Taylor Henry John Stoke Damerel 5b 245   
Deaths Jun 1858   (>99%)
Taylor Henry Plymouth 5b 166   
Taylor Henry Bideford 5b 361   
Deaths Dec 1858   (>99%)
Taylor Henry William Solomon Exeter 5b 93   
Deaths Sep 1860   (>99%)
Taylor Henry St Thomas 5b 39   
Deaths Mar 1861   (>99%)
Taylor Henry Newton A 5b 116   
Deaths Dec 1861   (>99%)
Taylor Henry Axminster 5b 8
_____________________