I agree with your first part, Buck AND Torre let him get away with murder.
To me, though, fielding percentage could be overrated. I remember a Bill Russell who took a beating from the press for all the errors he made. Yet, he was considered by many to be one of the best in the game at SS at that time. I won't mention any names, but he played beside a guy that wouldn't try for a ball if his family's well being depended on it.