Find the shortcut. Learn the biology.
Automated quality control for genomic machine learning datasets: scores the biases, duplicates and data leakage a classifier could exploit before you train on it.
Searching test set H3K4me3_test.csv.gz against train set H3K4me3_train.csv.gz
Data Leakage:!WarningHow a flag is decided →
gb-qc v1.0.0 · run 2026-09-15 22:31:08

Basic Descriptive Statistics

Filename H3K4me3_test.csv.gz H3K4me3_train.csv.gz
Number of sequences 776 17468
Minimum length 1000 1000
Mean length 1000.00 1000.00
Maximum length 1000 1000

Every test sequence searched against the train set with MMseqs2, and scored on its best hit. Similarity is min(query coverage, target coverage) × percent identity: how much of the shorter sequence the alignment spans, times how much of that matches. The histogram is the distribution of those best hits.

The flag is the percentage of test sequences at or above the threshold: Pass at 0%, Warning below 2%, Fail at 2% or more. A test sequence that near-duplicates a training one is one the model has already seen, so the accuracy it earns there is not evidence. What to do about it →

The panel under the histogram lists those alignments, up to the first 100; every one of them, listed or not, is exported to mmseqs/mmseqs2_search_result.tsv beside this report. Its columns are:

Query (Q)
Identifier of the test sequence: seq_<i>_test, where i is its 0-based position in the input test file.
Target (T)
Identifier of the train sequence: seq_<i>_train, where i is its 0-based position in the input train file.
Q Cov.
Fraction of the query sequence covered by the alignment (0–1).
T Cov.
Fraction of the target sequence covered by the alignment (0–1).
% Identity
Percent identical aligned positions in the aligned region.
% Similarity
Similarity score used for leakage detection, calculated as min(Q Cov., T Cov.) × % Identity.
E-value
MMseqs2 E-value (lower is more "significant").
Alignment
Click “Show” to expand the alignment visualisation for a row.
Filename H3K4me3_test.csv.gz H3K4me3_train.csv.gz
Data Leakage (percentage) 0.39% 0.02%
Data Leakage (count) 3 4
Similarity Histogram
4 high-similarity alignments
Query (Q) Target (T) Q Cov. T Cov. % Identity % Similarity E-value Alignment
seq_664_test seq_11345_train 0.99 0.99 96.3 95.63 0.00e+00
seq_664_test seq_15584_train 1.00 1.00 94.9 94.62 0.00e+00
seq_741_test seq_11654_train 0.94 0.94 97.9 91.83 0.00e+00
seq_480_test seq_8786_train 0.99 0.99 92.2 91.55 0.00e+00