From this link it looks like Edward A. Mitchell was the postmaster of New Haven and lived from 1815-1876.

https://siegelauctions.com/display_census.php?id=248

If you google his name you come up with a lot of links to stamp collecting websites. It sounds like he was a prominent political figure during his time. I browsed a little but couldn't find any reference to where his house was.