Skip to content

feat(InputMocking): generate mock input using LLM given instructions #695

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 1 commit into from
Oct 16, 2025
Merged

feat(InputMocking): generate mock input using LLM given instructions #695

merged 1 commit into from
Oct 16, 2025
+269 −1

Conversation

bai-uipath
Copy link
Collaborator

@bai-uipath bai-uipath commented Oct 14, 2025 •
edited
Loading

This PR adds LLM-based input mocking, using prompt configured in inputMockingStrategy in the evaluation JSON.

Currently missing the input schema (which we will extract from the agent definition, once it is available).

@github-actions github-actions bot added test:uipath-langchain Triggers tests in the uipath-langchain-python repository test:uipath-llamaindex Triggers tests in the uipath-llamaindex-python repository labels Oct 14, 2025
@bai-uipath bai-uipath changed the title [WIP] feat(InputMocking): generate mock input using LLM given instructions feat(InputMocking): generate mock input using LLM given instructions Oct 14, 2025
@bai-uipath bai-uipath marked this pull request as ready for review October 14, 2025 22:44
@bai-uipath bai-uipath requested a review from akshaylive October 14, 2025 22:44
akshaylive
akshaylive requested changes Oct 15, 2025
View reviewed changes
@bai-uipath bai-uipath mentioned this pull request Oct 15, 2025
Draft
akshaylive
akshaylive approved these changes Oct 16, 2025
View reviewed changes
Copy link
Collaborator

@akshaylive akshaylive left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This line need not exist right?

@pytest.mark.httpx_mock(assert_all_responses_were_requested=False)

Otherwise, LGTM!

@bai-uipath bai-uipath merged commit a545fa3 into main Oct 16, 2025
59 checks passed
@bai-uipath bai-uipath deleted the bai/input-mocking branch October 16, 2025 20:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@akshaylive akshaylive akshaylive approved these changes

Assignees

No one assigned

Labels

test:uipath-langchain Triggers tests in the uipath-langchain-python repository test:uipath-llamaindex Triggers tests in the uipath-llamaindex-python repository

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@bai-uipath @akshaylive