LLM Prompt Eval Tool is an app that enables developers at Pythagora to evaluate prompts on different LLMs multiple times in parallel. You enter a prompt, select the LLMs you want to test, and specify how many times you want to run it. The tool executes the prompt on the chosen LLMs the desired number of times and displays the results. You can also create a review prompt that evaluates the responses and shows the success rate for each selected LLM model. This is an invaluable tool that all developers at Pythagora use daily.

Custom HR Selection Tool is an app built with Pythagora for a company with a very specific hiring process they wanted to automate. The tool enables them to set up their custom process exactly as they want it, send a shareable link to applicants, and follow the tool’s instructions to review candidates. Recruiters can mark applicants, send emails from predefined templates, and move them through the hiring funnel, while applicants can manage necessary documents, complete assignments, reapply, and view job postings.

Custom User Management Tool is an app developed for Pythagora’s customer support team to manage user data aggregated from various sources like Stripe, BricksAI, and our Mongo database. The tool allows support staff to look up users, view their usage of Pythagora and spending, issue refunds and free credits, manipulate subscriptions, or change user statuses. It consolidates data from multiple sources to streamline customer support operations.