What AI chatbots are doing under-the-hood, LLMs from scratch part 1

Preview

How AI chatbots like ChatGPT work under the hood -- the post I wish I’d found before starting 'Build a Large Language Model (from Scratch)'.

What AI chatbots are doing under-the-hood, LLMs from scratch part 1

Link: https://www.gilesthomas.com/2025/08/what-ai-chatbots-are-doing-under-the-hood

Context

This is a great series, I am reading more about it this weekend. LLMs are things that produce logits, which is like a list of probabilities from a vocabulary and for each token the highest probability token should have been chosen, however it is random the temperature determines how random the selection is, 0 means choose the first(highest probable, no creativeness), 1 means choose any random one. Between these 0 and 1 you can experiment to find the sweet spot for your needs.

Work Hard, have fun, go home

Work Hard, have fun, go home

Link: https://www.bonnycode.com/posts/work-hard-have-fun-go-home/

Context

If you have fun you can work sustainably, else no matter how trendy or shinny the technology you would use, you won’t endure it long enough on the verge of burnout and the feeling of unsatisfied will crumble your efforts. Maintaining balance is key, but flowing with the excitement and energy is also helpful not always but can be done to improve the fun and memorable parts.

13 Reason why SQL has to GO

Preview

Why is the language developers and DBAs use to organize data such a mess? Here are 13 reasons we wish we could quit SQL, even though we probably won't.

13 Reason why SQL has to GO

Link: https://www.infoworld.com/article/2335455/13-reasons-sql-has-got-to-go.html

Context

https://www.infoworld.com/article/2335455/13-reasons-sql-has-got-to-go.html I don’t like this take, nor I think is grounded. Its looking like a AI slop or maybe someone just living in the land of NoSQL. “Tables don’t scale”, what is the meaning of it? If that’s the case, then collections also don’t? Right? I bet PostgreSQL and MySQL aren’t using tables, then it means that MySQL doesn’t scale, come on! I don’t want to react to this clickbait, I already know the pros and cons of SQL vs NoSQL, SQL isn’t going anywhere, and so is the good old MySQL. Relational Databases are the nuts and bolts of web, and without them, industry can fall apart pretty quickly. Unless MongoDB keeps them happy :)

Become the person who does the thing

Preview

Bad news: your internal identity dictates everything you do. Good news: you can change it

Become the person who does the thing

Link: https://www.fredrivett.com/2025/09/10/becoming-the-person-who-does-the-thing/

Context

https://www.fredrivett.com/2025/09/10/becoming-the-person-who-does-the-thing/ Yes, the world right now feels like everything is pushing me in a direction that I wanted, in my favor. For real! Journalling, job searching, embracing boredom, learning and locking in, and the most recent thing since almost a week, building a exercise routine. I also believed physical fitness is not important as mental well being. But I am coming to realize, there is no mental fitness if the body is not fit. At least it should be moving. By working remotely I was sucked into sitting and consuming junk/content. Feeling lethargic and exhausted all the time, last weekend, my brother set me up for an exercise, I felt energetic after that. I have been doing minimum 20 minutes each day since and keeping away from the vicious consumption cycle. Side by side, I am also on a writing streak of 24 on SQL and SQLite on my blog here with sqlog. This all is pushing me to get better and be the person I want to be. This article helps me validate everything I am doing, I don’t need validation for the actions I do, but a human is a social animal, he needs resonance and some level of accountability or validation for what I am heading for is the correct place or not.

Blogs used to be different

Preview

I saw someone earlier post about how intrusive it felt to read a personal blog post. They made a point that folks like them who have grown up on short form m...

Blogs used to be different

Link: https://jetgirl.art/blogs-used-to-be-very-different/

Context

This is so well written, the conversations have been lost, it feels all clickbait and flow where the trend takes me, instead of the flow or my curiosity. Blogging in earlier days, I am speaking from 2018-2020, I knew it used to be very much tied to google, I never read a lot of blog post at that time, so I can’t comment, but can feel the lack of social media would make it really amazing back then.

DNS Lookup from scratch

DNS Lookup from scratch

Link: https://youtu.be/CHaEdVIF2_M

Context

This was a refreshing post, it made me think, Programming is not dead yet. I have lost the motivation in streaming because of AI, no one would watch someone code something for hours, but this is bringing that back. The joy, the delight, the satisfaction of coding your own DNS from scratch in C, elite programmer. I would recommend subscribing this guy, full of energy.

I wrote a journal entry for everyday in 2024

I wrote a journal entry for everyday in 2024

Link: https://www.njbrown.com/blog/67/

Context

I had journaled for 1 year in paper, 2 years on my phone, and the last couple of years, have lost that habit. Life gets in the way, your habits change, but this I think I have to keep, it used to give me clarity and feeling of accomplishment. It has been exactly a month since I started journalling again, pen and paper, a tiny little book, around 50 words, I would cramp 100 in that little page. I love it, its like a glimpse of a quarter in a tiny book. I am also thinking of getting back to obsidian for digital journal, just because its accessible and searchable. This article I will give credit for bringing up searching and doing some analysis on the things I have already written, that would be exciting to find how I change or my writing changes me.

IT manager needed tech support because they had never heard of a command line

Preview

On Call: Traceroute was also a mystery to this mountebank

IT manager needed tech support because they had never heard of a command line

Link: https://www.theregister.com/2025/09/12/on_call/

Context

Can we all laugh here? I mean, yes its not needed, but at least heard of it! SKILL ISSUES. Or Maybe he was rich, he had macbook since his career began. I didn’t had a laptop, I found the command line on my android phone! Also discovered the world of Vim, because Nano and Vim was the only option, and I choose the Command line and Vim came along.

Just use SQL they say

Preview

“Just use SQL”, they say. “No need for ORMs”, they add. And they may be right, but… Let's look on how this can lead to accidental complexity piling on, derailing our initially simple problem.

Just use SQL they say

Link: https://www.architecture-weekly.com/p/just-use-sql-they-say-or-on-how-accidental

Context

Use tooling around it, there are SQLC tools for go and I think even for Python. It will help you write type safe boilerplate code in the native language as you write the SQL query. I think the author is right, but unaware of the tooling that exists around it.

Source: techstructive-weekly-59