Planned
Test Case Expected Results
When creating Test Cases, capture expected results (in addition to capturing the name and test conditions as Lamatic does currently). Consider also, Using code checks and AI to find deviation and grade result quality. Use this quality score as an input for deciding whether to deploy an update. Assist in recommending the best option when A|B testing prompts, agents, workflows, models and other settings such as temperature. Using these results to create benchmarks. Measuring and alerting about “model drift” over time. Integrating “human-in-the-loop” strategies to expand Test Cases and quality checking. Added Later (based on feedback from another user): Make it easier to see the history of Test Case executions (without leaving Experiments). Marc Greenberg didn’t realize he could find the results in Logs, but also didn’t like having to dig through logs to find the execution details for a given test.
cwhiteman 6 months ago
💡 Feature Requests
Planned
Test Case Expected Results
When creating Test Cases, capture expected results (in addition to capturing the name and test conditions as Lamatic does currently). Consider also, Using code checks and AI to find deviation and grade result quality. Use this quality score as an input for deciding whether to deploy an update. Assist in recommending the best option when A|B testing prompts, agents, workflows, models and other settings such as temperature. Using these results to create benchmarks. Measuring and alerting about “model drift” over time. Integrating “human-in-the-loop” strategies to expand Test Cases and quality checking. Added Later (based on feedback from another user): Make it easier to see the history of Test Case executions (without leaving Experiments). Marc Greenberg didn’t realize he could find the results in Logs, but also didn’t like having to dig through logs to find the execution details for a given test.
cwhiteman 6 months ago
💡 Feature Requests
Planned
Parse docs that contain structured data (i.e., tables)
When chunking, vectorizing and indexing an unstructured document, make it possible to correctly index any structured content embedded in that document. This might leverage logic from the Multi-modal Node. This is needed by Andrew at Beehive.
cwhiteman About 2 months ago
💡 Feature Requests
Planned
Parse docs that contain structured data (i.e., tables)
When chunking, vectorizing and indexing an unstructured document, make it possible to correctly index any structured content embedded in that document. This might leverage logic from the Multi-modal Node. This is needed by Andrew at Beehive.
cwhiteman About 2 months ago
💡 Feature Requests
Planned
Primary Key Selection in Indexing node
Primary Key not understandble - make this selectable from metadata fields instead
Aman Sharma 5 months ago
High Priority
💡 Feature Requests
Planned
Primary Key Selection in Indexing node
Primary Key not understandble - make this selectable from metadata fields instead
Aman Sharma 5 months ago
High Priority
💡 Feature Requests
Planned
Model Preference & Fallback
A dedicated UI to choose model preferences on project level. There will be different categories of models ( Tabs ) for Text | Embedding| Chat | Image | Audio | Transcript For Each category customer can create 5 Settings and reorder them. In each settings can choose 4 tabs ( Basic | Fallback | Best | A/B Test ) When using model selection in a workflow node, choose a preferred setting options which will populate the UI with credentials and model selection. ( By Default the first preference will be chosen or create a new preferences
Aman Sharma 6 months ago
💡 Feature Requests
Planned
Model Preference & Fallback
A dedicated UI to choose model preferences on project level. There will be different categories of models ( Tabs ) for Text | Embedding| Chat | Image | Audio | Transcript For Each category customer can create 5 Settings and reorder them. In each settings can choose 4 tabs ( Basic | Fallback | Best | A/B Test ) When using model selection in a workflow node, choose a preferred setting options which will populate the UI with credentials and model selection. ( By Default the first preference will be chosen or create a new preferences
Aman Sharma 6 months ago
💡 Feature Requests
Add Close Button to Configuration Dialog
To enhance the user experience, it is recommended to add a close icon button in the top-right corner of the configuration dialog to allow users to close it conveniently.
User 9 days ago
👏🏻 Feedback
Add Close Button to Configuration Dialog
To enhance the user experience, it is recommended to add a close icon button in the top-right corner of the configuration dialog to allow users to close it conveniently.
User 9 days ago
👏🏻 Feedback
Create node to vectorize structured data within unstructured docs
Beehive Climate’s context data are unstructured PDFs. Some of these docs have embedded tables. The content in these tables is not getting vectorized reliably which creates a problem for their application. Aman described a hypothetical node that would handle this use case.
cwhiteman 14 days ago
💡 Feature Requests
Create node to vectorize structured data within unstructured docs
Beehive Climate’s context data are unstructured PDFs. Some of these docs have embedded tables. The content in these tables is not getting vectorized reliably which creates a problem for their application. Aman described a hypothetical node that would handle this use case.
cwhiteman 14 days ago
💡 Feature Requests
Associate Test Cases with Flows
It would be helpful when testing a Flow to only see test cases for the selected Flow. One way to do this would be to use the schema to filter out test cases that don’t match the Flow.
cwhiteman 16 days ago
💡 Feature Requests
Associate Test Cases with Flows
It would be helpful when testing a Flow to only see test cases for the selected Flow. One way to do this would be to use the schema to filter out test cases that don’t match the Flow.
cwhiteman 16 days ago
💡 Feature Requests
Enhance Jobs list by showing the VDB it hits
If you’re looking at a list of multiple jobs, it would be helpful to see which vector db each updates so you can toggle on/off the right one without having to go look at each flow:
cwhiteman 16 days ago
💡 Feature Requests
Enhance Jobs list by showing the VDB it hits
If you’re looking at a list of multiple jobs, it would be helpful to see which vector db each updates so you can toggle on/off the right one without having to go look at each flow:
cwhiteman 16 days ago
💡 Feature Requests
Crash report (Sentry)
I clicked on this link from Vrijraj and instantly got this crash report: https://studio.lamatic.ai/Sandbox566/project/AcridXylophone/flow/VJS-GoogleDriveChatbot/edit
cwhiteman 16 days ago
🐛 Report Bug
Crash report (Sentry)
I clicked on this link from Vrijraj and instantly got this crash report: https://studio.lamatic.ai/Sandbox566/project/AcridXylophone/flow/VJS-GoogleDriveChatbot/edit
cwhiteman 16 days ago
🐛 Report Bug
Validate flow for missing nodes before saving
When user hits on Save, check for {{nodeId.output.*}} pattern in config of all nodes and see if the nodeId is valid or not. If not then don’t save the flow
aruna 20 days ago
👏🏻 Feedback
Validate flow for missing nodes before saving
When user hits on Save, check for {{nodeId.output.*}} pattern in config of all nodes and see if the nodeId is valid or not. If not then don’t save the flow
aruna 20 days ago
👏🏻 Feedback
Logs not coming up in Studio
I’ve been experiencing on demos a problem where the Logs function won’t respond (it just hangs). When I’m on with a customer, I change the subject and move on. But today I tested to see how long it would take to come up. I’m at 15 minutes now on Traq: There should be logged data as I watched them test a deployed API (hooked up to a custom chat widget they built).
cwhiteman 20 days ago
🐛 Report Bug
Logs not coming up in Studio
I’ve been experiencing on demos a problem where the Logs function won’t respond (it just hangs). When I’m on with a customer, I change the subject and move on. But today I tested to see how long it would take to come up. I’m at 15 minutes now on Traq: There should be logged data as I watched them test a deployed API (hooked up to a custom chat widget they built).
cwhiteman 20 days ago
🐛 Report Bug
Change Studio Title Dynamically
Enhancing Studio Tab Titles for Better Accessibility Problem Currently, when working on multiple flows across different browser tabs, the page title defaults to: Lamatic.ai | Studio. This makes it difficult to identify the correct tab for a specific flow or feature. Proposed Solution Update the page titles dynamically to improve accessibility and make tab identification more intuitive. For Flows: Display the flow name in the title. Example: - Lamatic.ai | Studio For Other Features/Services: Include the feature or service name in the title. Example: - Lamatic.ai | Studio
User 27 days ago
👏🏻 Feedback
Change Studio Title Dynamically
Enhancing Studio Tab Titles for Better Accessibility Problem Currently, when working on multiple flows across different browser tabs, the page title defaults to: Lamatic.ai | Studio. This makes it difficult to identify the correct tab for a specific flow or feature. Proposed Solution Update the page titles dynamically to improve accessibility and make tab identification more intuitive. For Flows: Display the flow name in the title. Example: - Lamatic.ai | Studio For Other Features/Services: Include the feature or service name in the title. Example: - Lamatic.ai | Studio
User 27 days ago
👏🏻 Feedback
Supabase integration
do native integration with supabas CRUD database CRUD file storage Crud users and other supabase API
Aman Sharma About 1 month ago
🔌 Integration
Supabase integration
do native integration with supabas CRUD database CRUD file storage Crud users and other supabase API
Aman Sharma About 1 month ago
🔌 Integration