Find the shortcut. Learn the biology.
Automated quality control for genomic machine learning datasets: scores the biases, duplicates and data leakage a classifier could exploit before you train on it.
Searching test set epigenetic_marks_prediction_H3K4me1_test.csv.gz against train set epigenetic_marks_prediction_H3K4me1_train.csv.gz
Data Leakage:!WarningHow a flag is decided →
gb-qc v1.0.0 · run 2026-09-15 22:30:44

Basic Descriptive Statistics

Filename epigenetic_marks_prediction_H3K4me1_test.csv.gz epigenetic_marks_prediction_H3K4me1_train.csv.gz
Number of sequences 3168 25341
Minimum length 290 310
Mean length 499.93 499.99
Maximum length 500 500

Every test sequence searched against the train set with MMseqs2, and scored on its best hit. Similarity is min(query coverage, target coverage) × percent identity: how much of the shorter sequence the alignment spans, times how much of that matches. The histogram is the distribution of those best hits.

The flag is the percentage of test sequences at or above the threshold: Pass at 0%, Warning below 2%, Fail at 2% or more. A test sequence that near-duplicates a training one is one the model has already seen, so the accuracy it earns there is not evidence. What to do about it →

The panel under the histogram lists those alignments, up to the first 100; every one of them, listed or not, is exported to mmseqs/mmseqs2_search_result.tsv beside this report. Its columns are:

Query (Q)
Identifier of the test sequence: seq_<i>_test, where i is its 0-based position in the input test file.
Target (T)
Identifier of the train sequence: seq_<i>_train, where i is its 0-based position in the input train file.
Q Cov.
Fraction of the query sequence covered by the alignment (0–1).
T Cov.
Fraction of the target sequence covered by the alignment (0–1).
% Identity
Percent identical aligned positions in the aligned region.
% Similarity
Similarity score used for leakage detection, calculated as min(Q Cov., T Cov.) × % Identity.
E-value
MMseqs2 E-value (lower is more "significant").
Alignment
Click “Show” to expand the alignment visualisation for a row.
Filename epigenetic_marks_prediction_H3K4me1_test.csv.gz epigenetic_marks_prediction_H3K4me1_train.csv.gz
Data Leakage (percentage) 0.06% 0.01%
Data Leakage (count) 2 2
Similarity Histogram
2 high-similarity alignments
Query (Q) Target (T) Q Cov. T Cov. % Identity % Similarity E-value Alignment
seq_2838_test seq_22808_train 0.98 0.98 93.6 91.35 6.84e-219
seq_2499_test seq_5613_train 0.99 1.00 91.2 90.47 3.87e-203