Demo of using LangChain.js with Next.js and Vercel Edge Functions (to stream the response)
by jaredpalmerTypeScript
Last 12 weeks · 0 commits
1 of 6 standards met
In the case of the non-streaming response, would a long running langchain chain run until completion? Say a 20 minute chain? I am aware usage is based on CPU Time and not wall time, but curious if there's a timeout at all. Th is would be a differentiating factor from others, for example, supabase edge functions iirc have a wall timeout of 1 minute, but is configurable if self hosting. If Vercel is offering edge functions with CPU Time pricing _and_ no limit on wall clock time, then this would be KILLER for openai use cases even more than people think, since it would be perfect for such long chains that don't require streaming - aka post processing using langchain chains and only paying for CPU time. @jaredpalmer
Repository: jaredpalmer/nextjs-langchain-example. Description: Demo of using LangChain.js with Next.js and Vercel Edge Functions (to stream the response) Stars: 40, Forks: 10. Primary language: TypeScript. Languages: TypeScript (85.7%), JavaScript (13.3%), CSS (1%). Topics: langchain, langchain-js, nextjs, vercel. Open PRs: 0, open issues: 1. Last activity: 3y ago. Community health: 28%. Top contributors: jaredpalmer.