If I put text into a box and out comes something useful I could give a shit less if it has a criteria for truth. LLM’s are a tool, like a mannequin, you can put clothes on it without thinking it’s a person, but you don’t seem to understand that.

I work in IT, I can write a bash script to set up a server pivot to an LLM and ask for a dockerfile that does the same thing, and it gets me very close. Sure, I need to read over it and make changes but that’s just how it works in the tech world. You take something that someone wrote and read over it and make changes to fit your use case, sometimes you find that real people make really stupid mistakes, sometimes college educated people write trash software, and that’s a waste of time to look at and adapt… much like working with an LLM. No matter what you’re doing, buddy, you still have to use your brian.

I understand your skepticism, but I think you’re overstating the limitations of LLMs. While it’s true that they can generate convincing-sounding text that may not always be accurate, this doesn’t mean they’re only good at producing noise. In fact, many studies have shown that LLMs can be highly effective at retrieving relevant information and generating text that is contextually relevant, even if not always 100% accurate.

The key point I was making earlier is that LLMs require a different set of skills and critical thinking to use effectively, just like a knife requires more care and attention than a spoon. This doesn’t mean they’re inherently ‘dangerous’ or only capable of producing noise. Rather, it means that users need to be aware of their strengths and limitations, and use them in conjunction with other tools and critical evaluation techniques to get the most out of them.

It’s also worth noting that search engines are not immune to returning inaccurate or misleading information either. The difference is that we’ve learned to use search engines critically, evaluating sources and cross-checking information to verify accuracy. We need to develop similar critical thinking skills when using LLMs, rather than simply dismissing them as ‘noise generators’.

See these:

• https://www.sciencedirect.com/science/article/pii/S2666651023000049
• https://arxiv.org/pdf/2308.07107
• https://medium.com/@daniele.nanni/revolutionizing-information-retrieval-the-role-of-large-language-models-in-a-post-search-engine-7dd370bdb62

I call myself an “IT systems engineer”.

Came to say exactly this. ISO8601 🔝🧠

Weird how “a nation of immigrants” wants to know where they are from.

There are alternate on-prem solutions that are now good enough to compete with vmware, for a majority of the people impacted by vmwares changes. I think the cloud ship has sailed and the stragglers have reasons for not moving to the cloud, and in many cases companies nove back from the cloud once they realize just how expensive it actually is.

I think one of the biggest drivers for businesses to move to the cloud is they do not want to invest in talent, the talent leaves and it’s hard to find people who want to run in house infra for what is being offered. That talent would move on to become SRE’s for hosting providers, MSP’s, ISP’s, and so on. The only option the smaller companies have would be to buy into the cloud and hire what is essentially an administrator and not a team of architects, engineers, and admins.

It was a dumb move. They had a niche market cornered, (serious) enterprises with on-prem infrastructure. Sure, it was the standard back in the late 2000’s to host virtualization on-prem but since then, the only people who have not outsourced infrastructure hosting to cloud providers, have reasons not to, including financial reasons. The cloud is not cheaper than self-hosting, serverless applications can be more expensive, storage and bandwidth is more limited, and performance is worse. Good example of this is openai vs ollama on-prem. Ollama is 10,000x cheaper, even when you include initial buy-in.

Let VMware fail. At this point they are worth more as a lesson to the industry, turn on your users and we will turn on you.

As a side note, I feel like this take is intellectually lazy. A knife cannot be used or handled like a spoon because it’s not a spoon. That doesn’t mean the knife is bad, in fact knives are very good, but they do require more attention and care. LLMs are great at cutting through noise to get you closer to what is contextually relevant, but it’s not a search engine so, like with a knife, you have to be keenly aware of the sharp end when you use it.

I guess it depends on your models and tool chain. I don’t have this issue but I have seen it for sure, in the past with smaller models no tools and legal code.

No, I don’t, but the misspelling was intentional.

There was a project a few years back that scrapped and parsed, literally the entire internet, for recipes, and put them in an elasticsearch db. I made a bomb ass rub for a tri-tip and chimichurri with it that people still talk about today. IIRC I just searched all tri-tip rubs and did a tag cloud of most common ingredients and looked at ratios, so in a way it was the most generic or average rub.

If I find the dataset I’ll update, I haven’t been able to find it yet but I’m sure I still have it somewhere.

I legiterally have an LLM use searxng for me.

When it’s important you can have an LLM query a search engine and read/summarize the top n results. It’s actually pretty good, it’ll give direct quotes, citations, etc.

Sure but you can benchmark accuracy and LLMs are trained on different sets of data using different methods to improve accuracy. This isn’t something you can’t know, and I’m not claiming to know how, I’m saying that with exposure I have gained intuition, and as a result have learned to prompt better.

Ask an LLM to write powershell vs python, it will be more accurate with python. I have learned this through exposure. I’ve used many many LLMs, most are tuned to code.

Currently enjoying llama3.3:70b by the way, you should check it out if you haven’t.

I use LLMs before search especially when I’m exploring all possibilities, it usually gives me some good leads.

I somehow know when it’s going to be accurate or when it’s going to lie to me and I lean on tools for calculations, being time aware, and web search to help with the lies.

Seriously, stop using Windows. If you set up a new computer, use Linux. Compared to everything we had in the 1990’s when we all decided to buy a computer and connect to the internet, modern Linux is fucking awesome, so think of it like prestiging in Call of Duty. You go back to the 90’s and start over, but it’s not nearly as bad, and it’s for a good cause.

Family need a new computer? Linux, Mac OS. Work need services deployed? Linux, FreeBSD.

Stop using Windows. Please. I stopped in 2013 and I’ve never been happier, it’s not been easy but I’m better now because of it and when I have to see Windows I fucking cringe and wonder how people can do it.

Break your addiction to the GUI, it’s not better than CLI, it augments it. Break your addiction to download and double click .exe to install applications. Break your addition video games that require Windows, you can run anything in Steam now (sans VR 😿). Break your addiction to your OS stopping you to apply “updates” and breaking your shit and blue screen frown face and moving your start windows logo button from the far left where it’s been for decades to the middle and showing you ads and introducing spy features and forcing their browser on you and their search engine and promising you good changes and good software just to deploy a half-baked product and begging you to “just wait it’ll get better”, to have it die in your arms and have ms just walk up rip it out of your arms and replace it with more half-baked software and promises, over and over. Break your addiction to MS telling you this is the last OS that you will ever buy every fucking release, having features taken from you and placed behind a pay wall, having simple applications like notepad which might have been fine in 1993 but then just remain the same for literally 20 fucking years, just to be overhauled to have tabs, something that notepad++ (which is free) has had since the beginning. Break your addiction to the abuse, this company is buying nuclear power plants to run datacenters to process data about you, that they basically are forcing you to be okay with, so that they can further increase their profit margins, and or enable governments to survey the public for whatever reason they deem necessary.

I’ve never worked with a worst registrar. It’s always a high priority to move our domains and assets away from them after acquisitions. There’s really no excuse for how bad they are.

They’re purposely not getting it.

One of the biggest hurdles, and one of the only reasons Windows is still alive. Linux doesn’t have a decent AD alternative.

I think I heard some very large governments, maybe Germany, was going to completely abandon Windows soon. This will generate a ton of demand for an AD alternative so I’m excited to see what happens.

Until then you have ansible, or salt may be more suitable for workstations 🤷

Oh, gotcha, that would be more successful for sure.