Posted 2026-06-29Updated 2026-07-02Study6 minutes read (About 890 words)2026-06-29-QWenVLQwen-VL Paper Notes: Visual Adapter, Cross-Attention, 2D Position Encoding, and RoPERead more
Posted 2026-06-29Updated 2026-07-02Study6 minutes read (About 918 words)2026-06-29-SlimeSearchR1ExampleTraining and evaluation of the slime Search-R1-trained Qwen2.5-3B model on NQ and HotpotQA.Read more
Posted 2026-06-10Updated 2026-07-15Study16 minutes read (About 2454 words)PPO vs GRPO — Post-Training Qwen2.5-0.5B-Instruct on GSM8K with veRLComparing PPO and GRPO for post-training Qwen2.5-0.5B-Instruct on GSM8K with veRL.Read more
Posted 2026-06-07Updated 2026-06-17Study18 minutes read (About 2732 words)2026-06-07-RLClassicClassic RL Methods including DP, MC, and TDRead more
Posted 2026-06-06Updated 2026-06-16Study14 minutes read (About 2119 words)2026-06-06-RLPreRL PreliminaryRead more
Posted 2026-06-03Updated 2026-07-02Study13 minutes read (About 1982 words)2026-06-03-SwingUpCartpoleFrom CartPole-v1 to CartPole Swing-UpRead more
Posted 2025-05-03Updated 2026-06-01Study4 minutes read (About 580 words)2025-05-03-ScanKogge-stone scan and Brent-Kung scanRead more