In-Memory Compute Chips for ML Inference
System-level evaluation of compute-in-memory (CiM) for accelerating GEMM in ML inference: compares analog vs digital CiM, cache-level integration, and optimal dataflows.
System-level evaluation of compute-in-memory (CiM) for accelerating GEMM in ML inference: compares analog vs digital CiM, cache-level integration, and optimal dataflows.
Technical overview of data center power management: hybrid capacitors, low?ESR components, precision resistors and wireless monitoring to improve efficiency and reliability.
Explains how generative adversarial networks (GANs) work and shows step-by-step training of a PyTorch GAN on MNIST, including network design and training loop.
Technical guide to scaling LLM training: analyzes memory usage, gradient accumulation, ZeRO, and tensor/data parallelism to improve throughput and GPU utilization.
OMGEval presents an open-source multilingual open-ended QA benchmark (804 Chinese prompts) localized from AlpacaEval, using Text-Davinci-003 baseline and GPT-4 evaluation.
Survey of length extrapolation approaches analyzing positional encoding methods and their effects on extending model context windows for long-sequence inference.
Technical guide to porting DeepSeek-R1 onto RK3588-based edge hardware: model conversion, cross-compilation, board deployment, and measured CPU, memory, and NPU performance.
Technical overview of random forest algorithms, bagging, bias-variance tradeoffs, and GPU-accelerated implementations (RAPIDS) for faster model training.
Analysis of the AI chips ecosystem: technical, commercial, and strategic factors shaping developer affinity, multi?generation platform continuity, and ecosystem influence.
Review of neural network quantization and numeric formats, covering floating vs integer, block floating point, logarithmic systems, and inference vs training trade-offs.