ABC
Highlights
- Pro
Block or Report
Block or report typpo
Report abuse
Contact GitHub support about this user’s behavior. Learn more about reporting abuse.
Report abusePinned
-
promptfoo/promptfoo
promptfoo/promptfoo PublicTest your prompts, models, RAGs. Evaluate and compare LLM outputs, catch regressions, and improve prompt quality. LLM evals for OpenAI/Azure GPT, Anthropic Claude, VertexAI Gemini, Ollama, Local & …
-
-
2,980 contributions in the last year
| Day of Week | January Jan | February Feb | March Mar | April Apr | May May | June Jun | July Jul | August Aug | September Sep | October Oct | November Nov | December Dec | January Jan | ||||||||||||||||||||||||||||||||||||||||
| Sunday Sun | |||||||||||||||||||||||||||||||||||||||||||||||||||||
| Monday Mon | |||||||||||||||||||||||||||||||||||||||||||||||||||||
| Tuesday Tue | |||||||||||||||||||||||||||||||||||||||||||||||||||||
| Wednesday Wed | |||||||||||||||||||||||||||||||||||||||||||||||||||||
| Thursday Thu | |||||||||||||||||||||||||||||||||||||||||||||||||||||
| Friday Fri | |||||||||||||||||||||||||||||||||||||||||||||||||||||
| Saturday Sat | |||||||||||||||||||||||||||||||||||||||||||||||||||||
Less
No contributions.
Low contributions.
Medium-low contributions.
Medium-high contributions.
High contributions.
More
Contribution activity
January 2024
Created 84 commits in 6 repositories
Created 2 repositories
-
typpo/llm-app-stack
This contribution was made on Jan 19
-
typpo/imgrag
TypeScript
•
Built by
This contribution was made on Jan 13
Created a pull request in typpo/quickchart that received 4 comments
fix chg handling in google image charts
Related to #189 https://quickchart.io/chart?cht=lc&chco=FF0000,00FF00,0000FF&chs=300x200&chd=s:FOETHECat,lkjtf3asv,KATYPSNXJ&chxt=x,y&chxl=0:%7COct…
+33
−33
lines changed
•
4
comments
Opened 22 other pull requests in 2 repositories
promptfoo/promptfoo
2
open
19
merged
-
feat(openai): Jan 25 model updates
This contribution was made on Jan 26
-
fix: do not require token usage info on openai provider
This contribution was made on Jan 25
-
feat: standalone share server
This contribution was made on Jan 24
-
feat: support for image models such as dall-e
This contribution was made on Jan 20
-
feat:
PROMPTFOO_DISABLE_TEMPLATINGdisables nunjucks templatesThis contribution was made on Jan 18 -
feat(webui): add markdown support
This contribution was made on Jan 18
-
feat(azure): add support for
passthroughandapiVersionThis contribution was made on Jan 16 -
feat: add
promptfoo generate datasetThis contribution was made on Jan 16 -
feat(webui): Ability to comment on outputs
This contribution was made on Jan 13
-
feat: update CSV and HTML outputs with more details
This contribution was made on Jan 12
-
feat(webui): label evals using
descriptionfieldThis contribution was made on Jan 12 -
feat(azure): add support for client id/secret auth
This contribution was made on Jan 11
-
feat(openai): add support for
passthroughrequest argsThis contribution was made on Jan 11 -
fix: proper support for multiple types of test providers
This contribution was made on Jan 10
-
feat(webview): add regex search
This contribution was made on Jan 7
-
feat: add perplexity-score metric
This contribution was made on Jan 7
-
feat: add logprobs support for azure openai
This contribution was made on Jan 7
-
fix: use relative paths consistently and handle object formats
This contribution was made on Jan 7
-
feat: support standalone assertions on CLI
This contribution was made on Jan 4
-
feat: add
costassertion typeThis contribution was made on Jan 2 -
fix: do not dereference tools and functions in config
This contribution was made on Jan 1
a16z-infra/llm-app-stack
1
merged
-
Add promptfoo to eval list
This contribution was made on Jan 19
92
contributions
in private repositories
Jan 2 – Jan 27





