Introducing Pytest and Vitest integrations for LangSmith Evaluations

LangSmith has introduced new integrations for its evaluation platform with the testing frameworks Pytest and Vitest/Jest. This allows developers to use familiar software testing workflows to assess the performance and quality of their LLM applications. The integrations enable logging inputs, outputs, and nuanced feedback to LangSmith for improved debugging, observability, and collaboration. This method provides more flexibility than traditional evaluation functions by allowing for specific evaluation logic per test case and easier integration into CI/CD pipelines.