I absolutely wouldn't rely on AI for anything potentially dangerous (like hand load formulas).
Do hallucinations and slop still exist, absolutely. But they are massively reduced over even a few months ago.
Also, I would be cautious conflating agents and their actions with open source LLMs (Claude, Gemini, Grok, Chat GPT).
Most people's "issues" with Generative AI isn't the model's capability but the lack of context or clear prompt provided.
Typing a list of words into Google Search and relying on the AI Overview is massively different than providing a well refined prompt with depth and context to Gemini, Gemini Pro, Gemini Ultra (let alone the various Anthropic and OpenAI tiers of models).
Here's an anecdotal example:
If I type "Montana trout fishing next weekend where to go" into Google Search the results are drastically different than if I type this prompt into even the free version Google Gemini (3.6 Flash Model):
"I am an above average fly fisherman that lives in XXX, Montana. I have fly rods from 3wt to 8wt with both floating lines and immediate sink tips. This time of year, I prefer dry fly fishing, but I am willing to nymph or steamer fish based on conditions. I prefer walk and wade, but also have access to a drift boat and raft.
Give me at least four options of where I should go fishing this weekend within 3 hours of XXX, Montana from 9a-7p Saturday and 9a-12p Sunday. What flies should I bring based on hatch forecast and does it change throughout the day? Include some pros and cons for each option and an overall recommendation.
Make sure to reference:
Fishing reports within the last 10 days from local guides, outfitters, and fly shops
Current USGS published flow rates and water temperatures, as well as daily trends from the last 7 days
Any hoot owl restrictions posted by Montana FWP
Local weather forecasts for each recommended river
Also take into consideration fishing pressure and public access, using public land boundaries, bridge crossings, fishing access sites (listed on FWP's website), and Montana's stream access laws as reference"
The results get even better if you use an account/log-in and continue the same chat thread. The model remembers you, the previous context you provided, the previous question and follow-up questions asked, etc and continues to refine how it interacts and communicates with you.