shlogg · Early preview
Obyeongjin @sunrabbit123

LLMs And JSON Syntax: Reliably Generating Code With Json_mode

LLMs generate responses token by token, probabilistically. Influence these probabilities to discourage incorrect tokens & get code snippets in JSON, CSV or Python with correct syntax using "json_mode", structured output or function calling.