DEV Community

#cuda

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
One Spark, four streams: TensorFold’s native CUDA experiment
sparkllm profile

One Spark, four streams: TensorFold’s native CUDA experiment

#ai #opensource #machinelearning #cuda
3 min read
Quantize or Offload? A 16GB GPU Local LLM Strategy
renato_silva_71eef0fc385f profile

Quantize or Offload? A 16GB GPU Local LLM Strategy

#localllm #machinelearning #python #cuda
4 min read
I built a free Windows (UEFI) & Linux GUI to unlock RTX 40/30/20 Tensor Cores (2.01x FP16/BF16/FP8 on my RTX 4070 Ti)
mindallik profile

I built a free Windows (UEFI) & Linux GUI to unlock RTX 40/30/20 Tensor Cores (2.01x FP16/BF16/FP8 on my RTX 4070 Ti)

#machinelearning #opensource #cuda #python
1
3 min read
Same A40, same Spark file: inside cortiq’s new CUDA path
sparkllm profile

Same A40, same Spark file: inside cortiq’s new CUDA path

#ai #opensource #cuda #machinelearning
4 min read
Splitting Network Paths with Two NICs to Get CUDA Working on RTX 5060 under WSL2 on Windows 11
maskedridersystem profile

Splitting Network Paths with Two NICs to Get CUDA Working on RTX 5060 under WSL2 on Windows 11

#linux #cuda #nvidia
4 min read
I had an AI agent port Karpathy's GPT-2 trainer from CUDA to SYCL, and made it prove every step
checocadena profile

I had an AI agent port Karpathy's GPT-2 trainer from CUDA to SYCL, and made it prove every step

#cuda #gpu #ai #opensource
4 min read
How Does Rust Code Run on a GPU? Tracing cuda-oxide and PTX
masamori profile

How Does Rust Code Run on a GPU? Tracing cuda-oxide and PTX

#rust #gpu #cuda #computerscience
10 min read
Project EREN: My Journey to Building a CUDA-Powered LLM Inference Engine
pathakarunav123 profile

Project EREN: My Journey to Building a CUDA-Powered LLM Inference Engine

#ai #llm #cuda #opensource
1
4 min read
TorchTPU vs CUDA: Can Native PyTorch Make Google TPUs Easier to Use?
jamilxt profile

TorchTPU vs CUDA: Can Native PyTorch Make Google TPUs Easier to Use?

#pytorch #tpu #cuda #ai
1
8 min read
Qwen3.8-Flash-Next (125B) on an RTX 3060 12 GB with 30 GB RAM: 50-70 tok/s
sumit_sodhi profile

Qwen3.8-Flash-Next (125B) on an RTX 3060 12 GB with 30 GB RAM: 50-70 tok/s

#llm #opensource #cuda #machinelearning
1
2
3 min read
Amazon: New TorchNeuron tool challenges Nvidia's dominance
hacksgr profile

Amazon: New TorchNeuron tool challenges Nvidia's dominance

#torchneuron #pytorch #trainium #cuda
1
2 min read
Running NVIDIA's new 120B Nemotron-3.5-Super on an 8 GB GPU — skipping the zeros, and finding the real bottleneck
helgard_orlm profile

Running NVIDIA's new 120B Nemotron-3.5-Super on an 8 GB GPU — skipping the zeros, and finding the real bottleneck

#ai #llm #cuda #python
7 min read
One Word, Two GPUs: Why Gemma 4 Answers the Same Question Differently on a Laptop and a Tesla T4

Hardware differences subtly alter benchmark grades
xbill profile

One Word, Two GPUs: Why Gemma 4 Answers the Same Question Differently on a Laptop and a Tesla T4

#gemma #llamacpp #cuda #nvidia
28
7
12 min read
I wrote 21 CUDA kernels on a free GPU. Here's what the profiler taught me.
musharaf_khanpathan_90de profile

I wrote 21 CUDA kernels on a free GPU. Here's what the profiler taught me.

#cuda #gpu #performance #cpp
5 min read
Running vLLM natively on Windows
aivrar profile
aivrar

Running vLLM natively on Windows

#vllm #windows #cuda #llm
6 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.
⌂