The Ask AI
block allows users to interact with a large language model (LLM) through various prompts, including inquiries and actions such as summarization, idea generation, or reasoning. It effectively handles additional context to improve response relevance and offers structured outputs through predefined functions like OpenAI Functions or JSON mode.
I/O | Feature | Type | Simple Explanation |
---|---|---|---|
input | question | string | The main inquiry you want to present to the LLM. Clear and detailed questions lead to more accurate responses. |
input | context | string | Background details related to your question that improve the specificity of the response. |
input | function | string | Enables the provision of OpenAI functions for models in the GPT family; these can be defined easily using the Define OpenAI Function block. |
input | model | selector | The specific LLM model that will generate an inference based on your inputs. |
input | json_mode | boolean | Activating this ensures the AI’s output is formatted strictly in JSON format when responding. |
input | cache_response | boolean | Enabling this feature allows repeated responses without additional AI calls if inputs remain unchanged, optimizing performance. |
output | response | string | The LLM’s response, formatted as a string if json_mode is enabled. |
Consider how this block could be utilized effectively:
In essence, whenever there’s a need for dynamic interactions with language models while maximizing output relevance and utility, the Ask AI
block is an essential tool!