I think this is just the Jerry Reese and Gettleman years wearing you down. Only getting 2 quality players out of each draft means each year you have 12 positions that need to be filled by free agents just to field your starters. You can't build a team that way.
Ideally, each draft NEEDS to have 2 impact players and 2 quality-to-decent starters come out of it.
I heard a really great rationale for taking a WR even if he's a diva on Talkin' Giants. They basically said if he's good but an asshole, you can always trade him for another 1st later (Beckham, Brown, Cooks, etc).