CodeBERTScore: an automatic metric for code generation, based on BERTScore
-
Updated
Mar 1, 2024 - Jupyter Notebook
#
bertscore
Here are 47 public repositories matching this topic...
EMNLP'2022: BERTScore is Unfair: On Social Bias in Language Model-Based Metrics for Text Generation
natural-language-processing deep-learning text-generation fairness-ai fairness-ml pretrained-language-model bertscore metric-bias
-
Updated
Oct 19, 2022 - Jupyter Notebook
LLM Evaluation and Observability System for Football Content
python mongodb pre-commit openai cosine-similarity evaluation-metrics comet-ml hallucination huggingface-transformers zenml bertscore
-
Updated
Jun 19, 2025 - Python
MAchine Translation Evaluation Online (MATEO)
machine-translation comet ter bleu clarin machine-translation-metrics streamlit bertscore bleurt machine-translation-evaluation chrf
-
Updated
May 8, 2026 - Python
Domain-specialized Gemma 2 27B + Gemma 4 31B for SEC filings — fine-tuned on TPU v6e-8 with PyTorch/XLA FSDPv2, plus a Vertex AI Vector Search RAG demo (69 tickers × 381 filings). Same LoRA recipe, +3.5% / +5.8% BERTScore F1.
finance lora knowledge-distillation gemma tpu peft sec-filings rag streamlit pytorch-xla vertex-ai bertscore gemma-2 gemma-4
-
Updated
Apr 26, 2026 - Python
Fine-tuning GPT-3.5 and Llama3 LLMs for enhanced persona consistency in chatbots using Google's Synthetic Persona Chat dataset
-
Updated
May 3, 2025 - Jupyter Notebook
ViAG: A Novel Framework for Fine-tuning Answer Generation models ultilizing Encoder-Decoder and Decoder-only Transformers's architecture
meteor question-answering bart llama rouge bleu-score encoder-decoder fine-tuning answer-generation t5 plms bartpho llm bertscore instruction-tuning qlora qwen decoder-only vit5
-
Updated
May 26, 2025 - Python
Agent Orchestration - LLM for Legal Metadata Extraction: A Comparative Analysis of Efficiency and Precision (paper 161 PROPOR)
-
Updated
Jul 26, 2026 - Python
LLM evaluation on a 643-question Austrian tax-law benchmark: ROUGE, BLEU and BERTScore plus a manual failure-mode analysis. Compares a QLoRA fine-tuned 5B model against a 31B zero-shot baseline; the smaller fine-tuned model wins on all five metrics.
python nlp machine-learning lora bleu-score fine-tuning huggingface legal-nlp llm bertscore qlora llm-evaluation peft-fine-tuning-llm unsloth rouge-score gemma4
-
Updated
Jul 26, 2026 - Jupyter Notebook
Medical Question Answering System using on PubMed dataset.
-
Updated
May 29, 2025 - Jupyter Notebook
Model-agnostic toolkit to evaluate text-summarization models — ROUGE/BLEU/BERTScore + perplexity + LLM-as-judge, MLflow tracking, CLI + library with unit-tested metrics.
python nlp cli evaluation transformers text-summarization rouge bleu perplexity mlflow huggingface bertscore llm-evaluation llm-as-judge
-
Updated
Jul 25, 2026 - Python
Implementation of a task-specific QLoRA supervised fine-tuning pipeline for LLaMA-2-7B-Chat, developed for an independent study on structured cover letter generation.
nlp natural-language-processing transformers text-generation pytorch rouge lora model-evaluation fine-tuning peft huggingface llm bertscore supervised-finetuning qlora llama2 parameter-efficient-fine-tuning structured-generation
-
Updated
Jun 9, 2026 - Python
The work presented was developed during the internship, as researchers in the field of Natural Language Generation, at the Insid&s Lab laboratory in Milan-Bicocca. The work carried out deals with the creation of a framework for the correct assessment of the impact of the quality of the input datasets on the quality of the text generated by the N…
python natural-language-processing deep-learning torch artificial-intelligence lstm rdf-triples natural-language-generation nlg rouge-metric bleu-score transformer-architecture bertscore
-
Updated
Mar 30, 2026 - Jupyter Notebook
[radscore] Evaluation metrics for radiology report generation — BLEU, ROUGE, BERTScore, F1-RadGraph, CheXbert F1 & GREEN in one `pip install`.
machine-learning tutorial deep-learning medical-imaging rouge radiology evaluation-metrics bleu-score multilabel-classification medical-natural-language-processing chexpert report-generation healthcare-ai bertscore radiology-report-generation vision-language-model chexbert radgraph green-metric
-
Updated
Jun 16, 2026 - Python
An LLM-powered application that summarizes scientific research papers, extracts tables, and provides real-time evaluation using BERTScore (F1) and ROUGE. Built using Meta’s LLaMA 3–8B via Groq, with table extraction powered by pdfplumber and pandas.
-
Updated
Jul 23, 2025 - Python
Role-aware crisis tweet summarization using transformer baselines, automated reward scoring, and preference optimization.
natural-language-processing transformers text-summarization rouge disaster-response emergency-management crisis-informatics openai-api bertscore t5-small reward-modeling crisis-summarization tweet-summarization role-aware-summarization frecs-dataset
-
Updated
Jul 1, 2026 - Jupyter Notebook
AI-powered research paper summarizer built with Streamlit and Google Gemini. Supports customizable summaries, paper Q&A, ROUGE/BERTScore evaluation, and latency benchmarking.
python nlp artificial-intelligence summarization rouge research-paper gemini-api streamlit llm bertscore prompt-engineering generative-ai
-
Updated
Jun 24, 2026 - Python
An end-to-end prompt-based navigation task for the Pioneer Valley region: synthetic data, a custom evaluation suite, and several methods helping map the problem's Pareto front
graph-algorithms named-entity-recognition monte-carlo-simulation search-algorithm nlp-machine-learning nlp-keywords-extraction synsets a-star-algorithm nlp-datasets osmnx sentence-transformers constrained-decoding cross-attention bertscore llms ollama neurosymbolic-ai gliner-medium llama3 gliner2
-
Updated
Jul 4, 2026 - Jupyter Notebook
Improve this page
Add a description, image, and links to the bertscore topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the bertscore topic, visit your repo's landing page and select "manage topics."