Automated quality control for genomic machine learning datasets: scores the biases, duplicates and data leakage a classifier could exploit before you train on it.
Searching test set core_promoter_detection_tata_val.csv.gz against train set core_promoter_detection_tata_train.csv.gz
Every test sequence searched against the train set with
MMseqs2,
and scored on its best hit. Similarity is
min(query coverage, target coverage) × percent identity: how much of
the shorter sequence the alignment spans, times how much of that matches.
The histogram is the distribution of those best hits.
The flag is the percentage of test sequences at or above the
threshold: Pass at 0%, Warning below 2%, Fail at 2% or more. A test
sequence that near-duplicates a training one is one the model has
already seen, so the accuracy it earns there is not evidence.
What to do about it →
The panel under the histogram lists those alignments, up to the first
100; every one of them, listed or not, is exported to
mmseqs/mmseqs2_search_result.tsv beside this report. Its columns are:
Query (Q)
Identifier of the test sequence: seq_<i>_test, where i is its 0-based position in the input test file.
Target (T)
Identifier of the train sequence: seq_<i>_train, where i is its 0-based position in the input train file.
Q Cov.
Fraction of the query sequence covered by the alignment (0–1).
T Cov.
Fraction of the target sequence covered by the alignment (0–1).
% Identity
Percent identical aligned positions in the aligned region.
% Similarity
Similarity score used for leakage detection, calculated as min(Q Cov., T Cov.) × % Identity.
E-value
MMseqs2 E-value (lower is more "significant").
Alignment
Click “Show” to expand the alignment visualisation for a row.
Filename
core_promoter_detection_tata_val.csv.gz
core_promoter_detection_tata_train.csv.gz
Data Leakage (percentage)
4.89%
0.75%
Data Leakage (count)
30
37
37 high-similarity alignments
Query (Q)
Target (T)
Q Cov.
T Cov.
% Identity
% Similarity
E-value
Alignment
seq_425_test
seq_2912_train
1.00
1.00
100.0
100.00
1.63e-35
T CTTTATAAAGTGACCAAGCACACCTTTTCATCCAGTCTCAGCGTGGGGTGAAGCCTAGCAGCTATGAGGA
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Q CTTTATAAAGTGACCAAGCACACCTTTTCATCCAGTCTCAGCGTGGGGTGAAGCCTAGCAGCTATGAGGA
seq_284_test
seq_4405_train
1.00
1.00
100.0
100.00
1.63e-35
T CTTATATGAAGACTTCTTTTCTTCTTGAAGAATTTTATACTTTCTAAAATGTCATTTTGAAGCTGTCTGT
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Q CTTATATGAAGACTTCTTTTCTTCTTGAAGAATTTTATACTTTCTAAAATGTCATTTTGAAGCTGTCTGT
seq_547_test
seq_2522_train
1.00
1.00
100.0
100.00
1.63e-35
T AATATAAAAAAGGATTTCCTCCCGGAAGAGAGCGGCAGTTCGGAGAGATTTTTCTTAAGGAAGCAGAAGC
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Q AATATAAAAAAGGATTTCCTCCCGGAAGAGAGCGGCAGTTCGGAGAGATTTTTCTTAAGGAAGCAGAAGC
seq_199_test
seq_2620_train
1.00
1.00
100.0
100.00
1.63e-35
T TACTTTAAATTCAGAGTACGCACACGCCGATTTGCCCTTTTGATTCTTCCACAATCAGGGTAAGCATGCG
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Q TACTTTAAATTCAGAGTACGCACACGCCGATTTGCCCTTTTGATTCTTCCACAATCAGGGTAAGCATGCG
seq_302_test
seq_2980_train
1.00
1.00
100.0
100.00
1.63e-35
T CTTTAAATAGGGGAAGTCCACTTGTGCACGGCTGCTCCTTGCTATAGAAGACCTGGGACAGAGGACTGCT
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Q CTTTAAATAGGGGAAGTCCACTTGTGCACGGCTGCTCCTTGCTATAGAAGACCTGGGACAGAGGACTGCT
seq_295_test
seq_2396_train
1.00
1.00
100.0
100.00
1.63e-35
T GCAATAAGAGCCTGGTGGTGGCCCACGCGCAGGTGAGCGGTGGACGTGCGGCGCAGGTCCGGTACCTCAC
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Q GCAATAAGAGCCTGGTGGTGGCCCACGCGCAGGTGAGCGGTGGACGTGCGGCGCAGGTCCGGTACCTCAC
seq_172_test
seq_1322_train
1.00
1.00
100.0
100.00
1.63e-35
T GGTATAAGGGCAGGGCACATGTGGGCTGATGGGCACTGAAAACTACAGCAAGAACAAAGGGAAGACAAGA
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Q GGTATAAGGGCAGGGCACATGTGGGCTGATGGGCACTGAAAACTACAGCAAGAACAAAGGGAAGACAAGA
seq_290_test
seq_629_train
1.00
1.00
100.0
100.00
1.63e-35
T CATATGAATCCCACTCGACTTCTGAACTGGAGGATCTGACAGAGCCCGAGCAAAGAGAGCTCAAAACCAA
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Q CATATGAATCCCACTCGACTTCTGAACTGGAGGATCTGACAGAGCCCGAGCAAAGAGAGCTCAAAACCAA
seq_110_test
seq_2710_train
0.99
0.99
100.0
98.60
7.98e-35
T CCCCATAAAACCAGCTGAGTATTTGTGCCAGGAAGACTGCGTGCAGAAGGTGACTGTCTCAGTGGAGCTG
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Q CCCATAAAACCAGCTGAGTATTTGTGCCAGGAAGACTGCGTGCAGAAGGTGACTGTCTCAGTGGAGCTGG
seq_488_test
seq_1154_train
0.99
0.99
100.0
98.60
7.98e-35
T TATATATAAACTCAGCCCTGCCTTTGATGTTCAGCAACTGATTCACTGATCAGATTACAGGCATTTCATC
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Q ATATATATAAACTCAGCCCTGCCTTTGATGTTCAGCAACTGATTCACTGATCAGATTACAGGCATTTCAT
seq_302_test
seq_3215_train
0.99
0.99
100.0
98.60
7.98e-35
T CCTTTAAATAGGGGAAGTCCACTTGTGCACGGCTGCTCCTTGCTATAGAAGACCTGGGACAGAGGACTGC
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Q CTTTAAATAGGGGAAGTCCACTTGTGCACGGCTGCTCCTTGCTATAGAAGACCTGGGACAGAGGACTGCT
seq_597_test
seq_3505_train
0.99
0.99
100.0
98.60
7.98e-35
T TCCATAAAAGAAGCGTGGTGGGCGGGTCCCGGGCACCTGTGGTTTGGTGAGTCCTCCAGGTAACTGTGAT
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Q CCATAAAAGAAGCGTGGTGGGCGGGTCCCGGGCACCTGTGGTTTGGTGAGTCCTCCAGGTAACTGTGATG
seq_136_test
seq_2157_train
1.00
1.00
98.5
98.50
8.59e-34
T GGGTATAAAAAGGGCCCACAAGAGACCAGCTCAAGGATCCCAAGGCCCAACTCCCCGAACCACTCAGGGT
.|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Q AGGTATAAAAAGGGCCCACAAGAGACCAGCTCAAGGATCCCAAGGCCCAACTCCCCGAACCACTCAGGGT
seq_190_test
seq_2576_train
1.00
1.00
98.5
98.50
8.59e-34
T GGTATATACAGGGAGGCCAGGCAGCCTGGAGTTAGCCGACCGTTGCGAGACGTTGAGCTGCGGAAGATGA
|||||||||||||||||||||||||||||||||||.||||||||||||||||||||||||||||||||||
Q GGTATATACAGGGAGGCCAGGCAGCCTGGAGTTAGTCGACCGTTGCGAGACGTTGAGCTGCGGAAGATGA
seq_423_test
seq_3210_train
1.00
1.00
98.5
98.50
8.59e-34
T CAGATATAAGTATGAGAAATGACAGAAAGAAACAACAACTGGAAAAGAAGCATTGCATAAGACCAGGATG
||||||||||||||||||||||||||||||||||||||||||||||||||||.|||||||||||||||||
Q CAGATATAAGTATGAGAAATGACAGAAAGAAACAACAACTGGAAAAGAAGCACTGCATAAGACCAGGATG
seq_455_test
seq_4592_train
1.00
1.00
98.5
98.50
8.59e-34
T CAGCTATAAAAGCATGTTGGGCCAGTCCTCAGCATCCTAGTTCGCCACTGTCTGCTGCCACACGATGCTG
||||||||||||||||||||||||||||||||||||||||||.|||||||||||||||||||||||||||
Q CAGCTATAAAAGCATGTTGGGCCAGTCCTCAGCATCCTAGTTTGCCACTGTCTGCTGCCACACGATGCTG
seq_408_test
seq_3702_train
0.97
0.97
100.0
97.10
3.90e-34
T CCGCTTTAAGAGCCGGGCTAGCGATTGACAAGCAATAAACGCTGAGCGCCCGGCTGCGCTGGAGCCGCCC
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Q GCTTTAAGAGCCGGGCTAGCGATTGACAAGCAATAAACGCTGAGCGCCCGGCTGCGCTGGAGCCGCCCGG
seq_186_test
seq_1282_train
0.97
0.97
100.0
97.10
3.90e-34
T AGAATAAAACTCCAGCGAGATCCGGGCCGTGAACGAAAGCAGTGACGGAGGAGCTTGTACCACCGGTAAG
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Q AGAGAATAAAACTCCAGCGAGATCCGGGCCGTGAACGAAAGCAGTGACGGAGGAGCTTGTACCACCGGTA
seq_483_test
seq_26_train
0.97
0.97
100.0
97.10
3.90e-34
T TATGAAAACGGTGTGCTTATGGTGTGCCGGACCACAGGGGAGCCACAAAGATGACTCCTGTACGGTCCCT
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Q AATATGAAAACGGTGTGCTTATGGTGTGCCGGACCACAGGGGAGCCACAAAGATGACTCCTGTACGGTCC
seq_9_test
seq_3695_train
0.97
0.97
100.0
97.10
3.90e-34
T TCTATAACTTGGCTGGCGTGGAGGAGGCGCCGCCGGAGTCGGAGGGCGGGGAGCTAGGAGGAGGGAGCTC
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Q CCTCTATAACTTGGCTGGCGTGGAGGAGGCGCCGCCGGAGTCGGAGGGCGGGGAGCTAGGAGGAGGGAGC
seq_52_test
seq_4879_train
1.00
1.00
97.1
97.10
4.38e-32
T GGCATAAATTCAGGATCTCACCCTTCATTCCACAGACACACATAGCCTCTCTGCCCACCTCTGCTTCCTC
||||||||||.|||||||||||||||||||||||||||||||.|||||||||||||||||||||||||||
Q GGCATAAATTTAGGATCTCACCCTTCATTCCACAGACACACACAGCCTCTCTGCCCACCTCTGCTTCCTC
seq_364_test
seq_1636_train
1.00
1.00
97.1
97.10
4.38e-32
T CGTATAAAAGGCAGGTCTAGCAGACTAACCCACACTCTGCCTTTGGACGTGAGAGAGAGCGCACCTTTCA
||||||||||||||||||||||||||||||||||||||||||||||||.||.||||||||||||||||||
Q CGTATAAAAGGCAGGTCTAGCAGACTAACCCACACTCTGCCTTTGGACATGTGAGAGAGCGCACCTTTCA
seq_364_test
seq_4523_train
1.00
1.00
97.1
97.10
4.38e-32
T CGTATAAAAGGCAGGTCTAGCAGACTAACCCACACTCTGCCTTTGGACGTGAGAGAGAGCGCACCTTTCA
||||||||||||||||||||||||||||||||||||||||||||||||.||.||||||||||||||||||
Q CGTATAAAAGGCAGGTCTAGCAGACTAACCCACACTCTGCCTTTGGACATGTGAGAGAGCGCACCTTTCA
seq_56_test
seq_2494_train
0.97
0.97
100.0
97.10
3.90e-34
T GATATAAGAGGACGGCCCAGCAGAGGGATGAAGATTTTGGAGCCCAGCTGTGTGCCAGCCCAAGTCGGAA
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Q GTGATATAAGAGGACGGCCCAGCAGAGGGATGAAGATTTTGGAGCCCAGCTGTGTGCCAGCCCAAGTCGG
seq_27_test
seq_4093_train
0.97
0.97
100.0
97.10
3.90e-34
T CCTTTTTATACCTCCTTCCCGGGAGTCCGGCAGCCGCTGCTGCTGCTGCTGCTGCTGCTGCCGCCGCCGC
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Q AGCCTTTTTATACCTCCTTCCCGGGAGTCCGGCAGCCGCTGCTGCTGCTGCTGCTGCTGCTGCCGCCGCC
seq_217_test
seq_2914_train
0.97
0.97
100.0
97.10
3.90e-34
T CGTATAAGAACGGAGGGGGCGGCGGCGGGACGGCTCACTCGGTGCCGCTGCCTAGGGGCTGTAGAGGTCG
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Q TATAAGAACGGAGGGGGCGGCGGCGGGACGGCTCACTCGGTGCCGCTGCCTAGGGGCTGTAGAGGTCGCG
seq_7_test
seq_1453_train
0.97
0.97
100.0
97.10
3.90e-34
T AAACTATAAATACTGAATTATCGAACACTTGCCAGGCACTTCAGCAGAAGACAAGGAAACTGAAGAGTGA
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Q ACTATAAATACTGAATTATCGAACACTTGCCAGGCACTTCAGCAGAAGACAAGGAAACTGAAGAGTGAGT
seq_414_test
seq_3342_train
1.00
1.00
97.1
97.10
4.38e-32
T ATATTAGAGCCCCAGGTTCTGTGCCCTTTTCCTATCATCGCAAAACTCATGATGCTCCGGCTGCTCAGTT
||||||||||||||||.||||||||||||||||||||||.||||||||||||||||||||||||||||||
Q ATATTAGAGCCCCAGGCTCTGTGCCCTTTTCCTATCATCACAAAACTCATGATGCTCCGGCTGCTCAGTT
seq_604_test
seq_2254_train
0.97
0.97
100.0
97.10
3.90e-34
T GCTATATAAGCCAGCCAAAGTTGGCTGCACCGGCCACAGCCTGCCTACTGTCACCCGCCTCTCCCGCGCG
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Q TATATAAGCCAGCCAAAGTTGGCTGCACCGGCCACAGCCTGCCTACTGTCACCCGCCTCTCCCGCGCGCA
seq_455_test
seq_1973_train
1.00
1.00
97.1
97.10
4.38e-32
T CAGCTATAAAAGCATGTTGGGCCAGTCCTCAGCATCCTAGTTCACCACTGTCTGCTGCCACACGATGCTG
||||||||||||||||||||||||||||||||||||||||||..||||||||||||||||||||||||||
Q CAGCTATAAAAGCATGTTGGGCCAGTCCTCAGCATCCTAGTTTGCCACTGTCTGCTGCCACACGATGCTG
seq_136_test
seq_663_train
0.99
0.99
97.1
95.74
2.09e-31
T GGTATAAAAAGGGCCCACAAGAGACCGGCTCTAGGATCCCAAGGCCCAACTCCCCGAACCACTCAGGGTC
||||||||||||||||||||||||||.||||.|||||||||||||||||||||||||||||||||||||
Q AGGTATAAAAAGGGCCCACAAGAGACCAGCTCAAGGATCCCAAGGCCCAACTCCCCGAACCACTCAGGGT
seq_136_test
seq_4426_train
0.99
0.99
95.6
94.26
1.01e-29
T AGGGTATAAAAAGGGCCCACAAGAGACCGGCTCTAGGATCCCAAGGCCCAACTCCCCGAACCACTCAGGG
.||||||||||||||||||||||||||.||||.||||||||||||||||||||||||||||||||||||
Q AGGTATAAAAAGGGCCCACAAGAGACCAGCTCAAGGATCCCAAGGCCCAACTCCCCGAACCACTCAGGGT
seq_136_test
seq_3886_train
1.00
1.00
92.8
92.80
4.56e-27
T GGGTATAAAAAGGGCCCACAAGAGACCAGCTCCAGCATCCCAAGGCCCGACTCCCCGCACCACTCAGGGT
.|||||||||||||||||||||||||||||||.||.||||||||||||.||||||||.||||||||||||
Q AGGTATAAAAAGGGCCCACAAGAGACCAGCTCAAGGATCCCAAGGCCCAACTCCCCGAACCACTCAGGGT
seq_579_test
seq_4484_train
1.00
1.00
91.4
91.40
1.96e-25
T GCCATAAGATGGCGGCTGGGCTGACAGCCGGGACCCCGGGCGTCCTGTCTCCTCCCTGCGCAGTGACTGT
||||||||||||||||||.||||||||||.|||||||.||||||||.||||.||||||||.|||||||||
Q GCCATAAGATGGCGGCTGCGCTGACAGCCAGGACCCCAGGCGTCCTTTCTCTTCCCTGCGTAGTGACTGT
seq_466_test
seq_4757_train
1.00
1.00
91.4
91.40
1.96e-25
T AATACAAAAATTAGCCGGGCATGGTGGCGCGCGCCTGTAGTCCCAGCTACTCGGGAGGCTGAGGCAGGAG
||||||||||||||||.||..|||||||||||||||||||||||||||||||.|||||||.|||.|||||
Q AATACAAAAATTAGCCAGGTGTGGTGGCGCGCGCCTGTAGTCCCAGCTACTCTGGAGGCTAAGGAAGGAG
seq_376_test
seq_1871_train
0.99
1.00
91.4
90.12
3.81e-24
T TCCTATAAAACGGCCCCACCCCTATCTCCCTTCGCTGACTGTCTTTTTGGACTCAGCCCGCCTGCACCCA
|||||||||||.|||||||||||||||.|||| |||||.|.||||||.||||||||||||||||||||||
Q ATCCTATAAAACTGCCCCACCCCTATCTTCCTT-GCTGATTCTCTTTTCGGACTCAGCCCGCCTGCACCCA
seq_466_test
seq_2539_train
1.00
1.00
90.0
90.00
7.96e-24
T AATACAAAAATTAGCCAGGCGTGATGGCGCGCGCCTGTAGTTCCAGCTACTTGGGAGGCTGAGGGAGGAG
|||||||||||||||||||.|||.|||||||||||||||||.|||||||||..|||||||.|||.|||||
Q AATACAAAAATTAGCCAGGTGTGGTGGCGCGCGCCTGTAGTCCCAGCTACTCTGGAGGCTAAGGAAGGAG