peft-fine-tuning

Install

Runs in a terminal with Node.js 18 or newer. Add -y to skip the prompts and -g to install for every project instead of this one.

What it does

PEFT (Parameter-Efficient Fine-Tuning) Fine-tune LLMs by training <1% of parameters using LoRA, QLoRA, and 25+ adapter methods. When to use PEFT Use PEFT/LoRA when: - Fine-tuning 7B-70B models on consumer GPUs (RTX 4090, A100) - Need to train <1% parameters (6MB adapters vs 14GB full model) - Want fast iteration with multiple task-specific adapters - Deploying multiple fine-tuned variants from one base model Use QLoRA (PEFT + quantization) when: - Fine-tuning 70B models on single 24GB GPU - Memory is the primary constraint - Can accept ~5% quality trade-off vs full fine-tuning Use full…

Excerpt from the skill's own SKILL.md. Read the full file on GitHub before installing: skills run with your agent's permissions.

Related skills

• faiss

  Orchestra-Research/AI-Research-SKILLs

  Copy install command

  Facebook's library for efficient similarity search and clustering of dense vectors. Supports billions of vectors, GPU acceleration, and various index types (Flat, IVF, HNSW). Use for fast k-NN search, large-scale vector retrieval, or when you need pure similarity search without metadata. Best for high-performance applications.

  1.0K installs 14KResearchGit & GitHubDatabase
• mlflow

  Orchestra-Research/AI-Research-SKILLs

  Copy install command

  Track ML experiments, manage model registry with versioning, deploy models to production, and reproduce experiments with MLflow - framework-agnostic ML lifecycle platform

  1.0K installs 14KDeploy & DevOpsGit & GitHub
• serving-llms-vllm

  Orchestra-Research/AI-Research-SKILLs

  Copy install command

  Serves LLMs with high throughput using vLLM's PagedAttention and continuous batching. Use when deploying production LLM APIs, optimizing inference latency/throughput, or serving models with limited GPU memory. Supports OpenAI-compatible endpoints, quantization (GPTQ/AWQ/FP8), and tensor parallelism.

  1.0K installs 14KTestingAI & agentsProductivity
• tensorrt-llm

  Orchestra-Research/AI-Research-SKILLs

  Copy install command

  Optimizes LLM inference with NVIDIA TensorRT for maximum throughput and lowest latency. Use for production deployment on NVIDIA GPUs (A100/H100), when you need 10-100x faster inference than PyTorch, or for serving models with quantization (FP8/INT4), in-flight batching, and multi-GPU scaling.

  994 installs 14KAI & agentsPython
• autoresearch

  Orchestra-Research/AI-Research-SKILLs

  Copy install command

  Orchestrates end-to-end autonomous AI research projects using a two-loop architecture. The inner loop runs rapid experiment iterations with clear optimization targets. The outer loop synthesizes results, identifies patterns, and steers research direction. Routes to domain-specific skills for execution, supports continuous agent operation via Claude Code /loop and OpenClaw heartbeat, and produces research presentations and papers. Use when starting a research project, running autonomous experiments, or managing a multi-hypothesis research effort.

  950 installs 14KResearchAI & agentsOffice documents
• ray-train

  Orchestra-Research/AI-Research-SKILLs

  Copy install command

  Distributed training orchestration across clusters. Scales PyTorch/TensorFlow/HuggingFace from laptop to 1000s of nodes. Built-in hyperparameter tuning with Ray Tune, fault tolerance, elastic scaling. Use when training massive models across multiple machines or running distributed hyperparameter sweeps.

  950 installs 14KProductivity