This guide details the installation process for Instructlab + VLLM on Ubuntu 22.04 with an Nvidia CUDA Support.
nvidia
Drivers and CUDA Toolkit Setup for Nvidia on Fedora 40
First determine what driver is installed. Below we can see that we are running the "nouveau" driver and not the Nvidia proprietary driver. $ sudo lspci -n -n -k | grep -A 2 -e VGA -e 3D 01:00.0 VGA compatible controller [0300]: NVIDIA Corporation GA106 [GeForce RTX 3060 Lite Hash Rate] [10de:2504] (rev a1) Subsystem: … Continue reading Drivers and CUDA Toolkit Setup for Nvidia on Fedora 40
Step-by-Step Nvidia CUDA Toolkit Installation Guide: Ubuntu 24.04
The NVIDIA CUDA Toolkit is essential for developing GPU-accelerated applications and includes various tools. Users must uninstall older versions from Ubuntu before installing the latest toolkit from NVIDIA’s website for better performance and compatibility. The summary highlights differences between installation methods regarding version availability, ease, and update management.
Step-by-Step Nvidia CUDA Toolkit Installation Guide: Ubuntu 22.04
"The NVIDIA CUDA Toolkit is a software development kit that helps users create GPU-accelerated applications. It includes libraries, compilers, debuggers, and optimization tools". Since we have an Nvidia GPU we will install it as shown below. Note: If you installed the nvidia-cuda-toolkit from default ubuntu noble repo, uninstall it first as that version is probably too old. … Continue reading Step-by-Step Nvidia CUDA Toolkit Installation Guide: Ubuntu 22.04
Essential Commands to Monitor Nvidia GPUs in Linux
Identify Your GPU Via the Linux CLI Identify that your card is recognized by the OS via the CLI command below, hwinfo # hwinfo --gfxcard --short graphics card: nVidia TU104GL [Tesla T4] nVidia TU104GL [Tesla T4] Matrox G200eR2 Primary display adapter: #58 Or you can see similar output with lshw # lshw -C display *-display … Continue reading Essential Commands to Monitor Nvidia GPUs in Linux
Ollama CLI Quick Start Guide and Tutorial for Beginners – Part 1
This two-part guide introduces beginners to using Ollama, focusing initially on installation and model pulling. It explains essential commands and service configurations, discusses memory management, and provides troubleshooting tips for ensuring successful model installation and interaction with Ollama through the command line interface.
Finding and Mapping Jetson OS and JetPack Versions on the Nvidia Jetson
Updated - 2/24/2026 Below are all the methods that I have found to either find your Jetson OS version, or your Jetpack version (which includes Jetson OS version, Ubuntu version, CUDA Version, NVIDIA drivers, and firmware). First let's review the matrix and see how JetsonOS Maps to JetPack version (along with Ubuntu version, CUDA version, … Continue reading Finding and Mapping Jetson OS and JetPack Versions on the Nvidia Jetson