BJREES

B2B marketing and AI

Building an AI assistant to help do the work I love

Written by

admin37109

in

,

“If your job isn’t what you love, then something isn’t right” 1

If you are not passionate or at least interested in what your company does for customers then working in marketing is quite a slog. Of course parts of the marketing role which are less interesting than other parts (I’m no fan of doing expenses…) but if you aren’t interested in the world of marketing how it works and how you actually get customers – then you will struggle to give it your all. And part of that should be having a passion project in your job ❤️

Mine is AI. I studied it at college and I’ve always been interested in how the AI world is evolving. At times I have struggled to use it in work, but that has all changed with AI taking over the world.

I’ve been working on Project Skynet for a while now, but I am particularly excited about this next stage – running everything on my laptop.

Initial Setup Stage

I’ve only put one or two notes here because it will really depend on your machine and there are plenty of other places that give much better insights about how to set up Linux on a laptop. Below is what I did on my machine.

  • In Windows, I run cmd as an Administrator.
  • Install Windows Subsystem for Linux (WSL).
  • wsl --list --online
  • Going to use Ubuntu 22.04 LTS
  • dism.exe /online /enable-feature /featurename:Microsoft-Windows-Subsystem-Linux /all /norestart
  • dism.exe /online /enable-feature /featurename:VirtualMachinePlatform /all /norestart
  • wsl --set-default-version 2

Installing Ollama

This was the most interesting and exciting part for me. I had a presumption that it would not be possible to run this system on my laptop. Surely to be running a mini brain on my Dell just doesn’t make sense!? How wrong I was.

It definitely is the case that I can’t create ChatGPT 5 model! I might be able to run one of the ChatGPT 4 models, and I will experiment with that another time.

But I only want to run quite simple tasks so I’m actually just going to use Phi-3. as I say, I’m not planning to plot out a new moon orbit with this, just run some simple processes on my laptop.

Getting Ollama running

I will pause there mostly because I was very pleasantly surprised at how easy this all was to set up. I had originally thought that it would be multiple stages to get this up and running, but Ollma has made this so simple. So for now I will leave you with my first query on my laptop, not in the cloud:

But why am I bothering to do this? Why not just run this in the cloud? It certainly would be the simpler option. The problem with doing this is you aren’t really learning anything or developing your expertise and something new and exciting. This is what I personally enjoy, and so now that I have this up and running I will move on to the next stages – building a marketing assistant that is just running on my laptop.

There are other benefits too – I feel happier about privacy and security when it is running on my machine, I also feel more in control of the spend. but there is also a strange feeling that I don’t want to “rent” the infrastructure I would rather have it on my machine and own it. This was always my ambition but, as I say, I didn’t think it could be done on a laptop. I was wrong.

  1. Talking Heads, Found a Job ↩︎

More posts