Visual LLM pipeline builder
Dify's canvas lets you drag nodes: Start → LLM (select model, write prompt) → Knowledge Retrieval (connect RAG) → Code (Python/JS) → Answer. You can add conditionals, loop over results, and chain multiple LLM calls. For the customer support bot: Start → classify intent (LLM) → if 'billing' route to billing FAQ (RAG) → generate response (LLM) → Answer. Building this flow took 15 minutes of drag-and-drop vs 2 hours of Python code.
RAG knowledge base: upload and query in 5 minutes
Upload documents (PDF, TXT, Markdown, web pages) to a knowledge base. Dify chunks them, creates embeddings, and makes them queryable. The chunking supports custom separators and overlap. Embedding model options: OpenAI, Cohere, or local models. For the support bot, I uploaded 50 FAQ pages. Retrieval accuracy: 85% on simple questions, 70% on complex multi-part questions. The quality is good enough for internal tools, not yet production customer-facing.
Self-hosted vs cloud
Self-hosted: `docker compose up` pulls 6 containers (API, web, worker, Postgres, Redis, Weaviate). Runs on 4GB RAM minimum. Free, unlimited apps, unlimited users. Cloud: starts at $59/month, managed infrastructure, team features, SSO. Self-hosting is straightforward but the Docker Compose pulls 2GB of images. The cloud version eliminates ops at a price that is reasonable for businesses but steep for indie developers.
Agent mode: tool calling with visual config
Dify's agent mode lets the LLM use tools: web search, knowledge retrieval, code execution, API calls. Configure tools visually: select 'Web Search' tool, choose search engine (Google/Bing/serpAPI), set max results. The agent decides when to use each tool. I built an agent that: reads a user question → searches knowledge base → if not found, searches web → generates answer with citations. The agent correctly chose the right tool 80% of the time.
Dify vs LangFlow vs Flowise
Dify: most polished UI, best RAG, agent mode, cloud option. Best for production AI apps. LangFlow: LangChain visual builder, most flexible, steeper learning curve. Best for LangChain developers. Flowise: simplest, quickest to build chatbots, limited beyond chat. Best for rapid chatbot prototyping.