Skip to content

DEV Community

# gpu

👋 Sign in for the ability to sort posts by relevant, latest, or top.

I Want To Learn Programming

Jul 4

The KV cache, why LLM inference is memory-bound, not compute-bound

#gpu #llm #inference #performance

4 min read

Mike Smith for Hostrunway

Jul 3

The GPU Utilization Number That's Quietly Wrecking AI Team Budgets

#gpu #ai #machinelearning #deeplearning

5 min read

Jul 1

DGX Spark hitting 83 C under sustained Ollama load — solved by clock-locking via nvidia-smi -lgc

#nvidia #gpu #llm #ai

3 min read

skyne

Jun 27

Resurrecting Kepler: Getting Modern LLMs Running on a GTX 770 (Kernel 7.x)

#cuda #linux #llm #gpu

4 min read

Jun 28

Per-agent GPU cost: what LangSmith can't tell you

#ai #gpu #finops #llm

4 min read

Marina Kovalchuk

Jun 28

Managing Non-Homogeneous GPU and Resource Configurations in Ray Cluster IaC with Python-Based Solutions

#raycluster #iac #python #gpu

15 min read

Creeta

Jun 26

96% of cuBLAS, no `unsafe`: what cuTile Rust proves

#cutile #rust #gpu #inference

8 min read

NTCTech

Jun 23

GPU Scarcity Isn't the Problem Anymore. GPU Allocation Governance Is.

#kubernetes #gpu #platformengineering #devops

4 min read

Arsen Apostolov

Jun 23

How to Rank Local LLMs by Cost per Correct Answer (Measured GPU Energy, 8 Ollama Models)

#machinelearning #llm #gpu #opensource

4 min read

Mathis

Jun 19

Building a GPU-accelerated screen recorder in Rust with wgpu

#showdev #rust #gpu #wgpu

13 min read

soy

Jun 17

Linux GPU Drivers & Performance: AMD HDMI 2.1, Intel Panther Lake, & Open-Source AI Server

#gpu #nvidia #hardware

3 min read

Jun 17

Stable Diffusion Inference: Memory Requirements, Speed and GPU Selection

#nvidia #gpu

7 min read

soy

Jun 16

Blackwell MLPerf Dominance, Intel Nova Lake Compute Runtime, & Weston 16 Vulkan HDR

#gpu #nvidia #hardware

3 min read

soy

Jun 15

Linux Kernel 7.2 Boosts Performance with Rust Zerocopy & AI Optimizations

#gpu #nvidia #hardware

3 min read

Jun 14

Book Library: A Local RAG That Answers From My Own PDFs

#rag #python #localllm #gpu

5 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.