Talk to me

Can I run AI on my own computer?

A short learning video. No voice, only titles and screens, with music.

Vahid Alamipour

Learning video · 1 min 7 s ·

Video. A small AI moves from a cloud into a laptop and keeps working with the internet off. A private staff roster is read on the laptop, and nothing goes out. Then when to use the laptop and when to use the big online AI. 1 min 7 s, music only, no voice.

What this video shows

The answer comes first, in two lines. Yes, AI can run on your laptop. It works with no internet. On screen, a small AI travels down from a cloud into a laptop, then the laptop’s internet goes off, and the AI is still there.

Then one example. A staff roster is dragged into the laptop’s chat and someone asks: “Who works on Saturday?” The answer comes back from the laptop itself: “Sam and Lee work on Saturday.” The cloud above stays dark; nothing goes out. The answer writes itself a little more slowly than online, because the AI on a laptop is smaller.

The last part is what to do. Use it for private, simple jobs: a file you would not paste into a website, a short summary, a draft. Use the big online AI for hard jobs. And you do not need special equipment: a newer laptop is enough. When a business has documents that must stay on its own machines, a small model running in-house is often part of the AI apps I build for daily work.

What you will learn

  • That you can run an AI with no internet at all: free models and free tools download to an ordinary laptop.
  • Why it is private: your files and questions stay on the laptop.
  • The honest trade: a laptop model is smaller and slower than the big online ones.
  • When to use which: the laptop for private, simple jobs, the big online AI for hard ones.

The numbers behind the picture

Nothing with a digit is on screen. The numbers belong here.

  • 2025: OpenAI released its first open model in years, gpt-oss, in August; the smaller one runs “within 16GB of memory”. Apple opened its on-device model to app makers in June, free and offline. LM Studio, a popular desktop tool, became free for work use in July. Open models made up about 11% of business AI use in December, down from 19%. (OpenAI, August 2025; Apple, 9 June 2025; LM Studio, 8 July 2025; Menlo Ventures, December 2025)
  • 2026: Google’s Gemma 4 family (July) runs on laptops; the small size needs about 4.5 GB of memory. On a basic Apple laptop chip, a small model writes a few dozen word pieces a second. On one independent index, the best online model scores 58 and the best laptop-size model about 34. Microsoft and Google now ship small on-device models inside their own systems. (Google Gemma docs, 2026; llama.cpp benchmark; Artificial Analysis, read 8 October 2026; Microsoft and Google, 2026)
  • 2027, my guess: The gap narrows a little each year, and small on-device models become a normal part of phones and laptops. The big online models stay ahead on hard jobs, so the split in the film holds: private and simple on the laptop, hard work online. (Microsoft: its new on-device model reaches retail devices in January 2027; the rest is my guess)

Questions people ask

Can I run ChatGPT on my own computer?

Not ChatGPT itself; it runs on OpenAI’s servers. But you can run other AI models on your own computer, for free, with no internet: Google’s Gemma, Alibaba’s Qwen, Mistral’s small models, Microsoft’s Phi, and OpenAI’s own open model, gpt-oss. Free tools such as Ollama and LM Studio download and run them.

Is it really private?

The model runs on your machine, so your files and questions do not leave it. Ollama’s own help page says: “We don’t see your prompts or data when you run locally.” Australia’s privacy regulator, the OAIC, notes that running a system “locally or on premises is likely to be more privacy-preserving”.

How good is it compared to the big online AI?

Clearly behind on hard tasks. On one independent index in October 2026 the best online model scores 58 and the best laptop-size model about 34; many small models score much lower. For short summaries, drafts and questions about your own file it is often good enough: small for simple jobs, big for hard ones.

What computer do I need?

A recent laptop with 16 GB of memory is the usual advice from the tool makers. Small models need about 4.5 to 7 GB at the common compressed size; bigger ones need a stronger machine.

Further reading

When a business has files that must stay on its own machines, I build AI apps that keep the private work local and send only the hard, non-private work online (how I can help). Tell me about the work.

Transcript

Every line of text shown on screen, in order. Nothing is spoken. Each label stays at the bottom of the screen for at least four seconds.

Opening

  • Logo: vai SoftLab (small, no title line)

Scene one: the question

Alone on a dark screen, the biggest text in the film:

  • Can I run AI on my own computer?

Scene two: the answer

A laptop in the centre and a grey cloud above it. A small robot face sits in the cloud. A gold line drops from the cloud and a small gold box travels down it into the laptop. The robot face is now on the laptop screen.

Label: Yes. AI can run on your laptop.

The internet icon on the laptop fades and is crossed out. The cloud dims. The robot on the laptop stays bright.

Label: It works with no internet.

Scene three: one example

A hand drags a file onto the laptop’s chat:

  • Staff roster

Typed, letter by letter, then sent:

  • Who works on Saturday?

The answer writes itself, a little slowly. The cloud stays dim; no line goes up to it.

Label: Your file stays on your laptop.

The answer finishes:

  • Sam and Lee work on Saturday.

Label: Nothing goes out to the internet.

A small speed gauge appears for a moment, its needle on the low side.

Label: It is smaller and slower.

Scene four: what to do

Three small cards appear beside the laptop, each with a gold tick: a folder, a short note, a calendar page.

Label: Use it for private, simple jobs.

A larger card shows a long plan with many steps. A gold line goes from it up to the cloud, which brightens.

Label: Use big online AI for hard jobs.

The laptop moves back to the centre and its screen glows softly once.

Label: A newer laptop is enough.

Scene five: to remember

Dark screen. Two lines:

  • On your laptop: private, simple, a bit slower.
  • Online: bigger jobs.

Closing

  • Logo: vai SoftLab
  • vaisoftlab.com

Have an app idea, a stuck app, or a daily job you want an AI agent to do?

Write three lines. I reply within one working day with a plain answer.

Contact See how I can help

More videos

  1. A chat window with the same question asked twice: Write one line to thank a customer. Two different answers sit side by side, Thank you for shopping with us today, and Thanks so much for choosing us, each with a gold tick. The label reads: Both are fine. Same meaning.

    · 1 min 7 s video

    Why does AI give a different answer each time?

    A short silent video. The AI picks each next word with some chance, so the words change each time. When it matters, give it a form and check.

  2. A chat window on the left with a typed question. On the right, a shelf of small grey file icons under a gold tag that reads Your files; one file, Returns, is gold and open. A page slides from the file across the gap into the chat window. The label reads: It brings the right page in.

    · 1 min 7 s video

    What is RAG?

    A short silent video. RAG means the AI looks in your own files first and answers from the page it finds. One example, and what to do.

  3. A new, empty chat window at sunrise. Beside it, a small open notebook with a gold tag that reads Memory. One gold line, Shop: Blue Door, has slid from the notebook into the top of the chat window. The label reads: It reads the note first.

    · 1 min 10 s video

    Does the AI remember me tomorrow?

    A short silent video. The AI forgets you when the chat ends. Some apps keep a note and read it back next time. You can read, delete or switch it off.