I think part of my problem with Fisher is how much of that is on him.
2013: Not much, injuries happen, I doubt anyone could have predicted Bradford getting injured.
2014: You've got a QB coming off a major injury, you rush him back, and as a back up, arguably the most likely back up to see playing time in 2014, you sign a guy who hasn't started a game in 3 years, a guy who you your self decide isn't worth re-signing a year later. But that's OK because you get lucky, he get injured and it just so happens that you have a young guy with talent on the bench (OK maybe the fact I liked Davis is clouding my judgement), only problem is your D isn't ready until the half way point of the season, and the OL you've assembled is so bad that it gets your QB sacked 7 times in a single game, destroying any confidence that he had.
2015: You hand pick your QB, you decide that along with a future 2nd round pick he's worth more to you than the 1st round pick Cleveland is offering you. You decide that he's so good that he's worth a 2 year contract extension sight unseen, then 5 games in (in Fisher's own words) you begin to consider dropping him, and he plays so badly that by the end of game 9 he finally forces your hand and you are left with a guy who wasn't good enough to be on your active roster the previous season.
That's the other part of my problem, on O outside of RB I don't see much improvement at all, we have possibly the worst group of receivers (both WR and TE) in the league, the worst OL in the league, and it remains to be seen if we have the worst starting QB in the league, or just a bad one (or maybe a miracle will happen), and that's evidenced by our 31st ranked O, and how many HCs get 18 top 100 picks and 6 first round picks to improve a team?