" 
I don’t hear the retort of the rifle" A lot of this depends on the rifle or pistol.  
I've always used hearing protection at the range, but usually not while hunting.  But then I shot the head off a grouse with my .357 magnum pistol and I shot a black bear with my .44 magnum pistol, and although those were only one shot each, my ears rang for a day or more afterward.
And then in 2004 I bought a .375 RUM and in 2009 I bought a .300 Weatherby and had muzzle brakes installed on both of them.  That's when I began using foam ear plugs for 
all of my rifle hunting. 
On the first trip that I took my .300 Wby to Africa, I had a packet full of foam ear plugs, and I used a pair and offered them to my PH, except once.  We were driving and suddenly came across a good warthog, so I quickly jumped out of the truck and shot him.  One shot and immediately my ears started ringing.
Now I wear these orange ear plugs around my neck all of the time when I'm hunting, and it only takes a couple of seconds to put them on before I shoot.  With them I don't hear the report or feel the recoil of the shot.