toxpred

The 28 endpoints

The same method, with only the required similarity set per endpoint. Each row is that endpoint at its operating point: the strictest match that still answers about one compound in five.

Two rates are reported rather than percent correct. The labels are lopsided on most of these endpoints, and that ratio records which compounds were tested and reported rather than anything about chemistry. Caught is the share of measured actives called active. Passed is the share of measured inactives called inactive.

CategoryEndpointRequired similarityCoverageCaughtPassedMCCMeasured actives
Irritation and CorrosionEye Corrosion0.6523.4%100.0%100.0%1.0062
Irritation and CorrosionEye Irritation0.6526.8%99.2%96.5%0.96260
CYP450CYP1A20.7521.9%90.7%98.6%0.91161
MutagenicityAmes Mutagenicity0.8021.1%94.3%91.8%0.86212
CYP450CYP2C90.7521.6%84.0%95.7%0.80119
CYP450CYP2C190.7522.5%82.1%94.2%0.78207
CYP450CYP3A40.7520.5%85.4%89.7%0.75260
Endocrine DisruptionNR-AR-LBD0.7026.0%77.8%98.2%0.7527
CYP450CYP2D60.7521.2%68.8%97.0%0.7080
Endocrine DisruptionSR-MMP0.7023.8%76.4%92.4%0.6555
Endocrine DisruptionNR-AhR0.7023.9%60.6%98.0%0.6433
Respiratory ToxicityRespiratory Toxicity0.7526.6%87.5%79.0%0.6356
Endocrine DisruptionSR-ATAD50.7025.1%50.0%99.5%0.6216
HepatotoxicityHepatotoxicity0.7522.8%83.1%78.8%0.6277
Endocrine DisruptionNR-AR0.7023.5%48.5%99.0%0.6033
CardiotoxicityCardiotoxicity-50.8026.5%69.4%87.0%0.5836
CardiotoxicityCardiotoxicity-100.8026.5%79.6%78.8%0.5849
CardiotoxicityCardiotoxicity-10.8026.5%50.0%96.8%0.5720
Endocrine DisruptionNR-aromatase0.7022.1%58.8%97.6%0.5617
Endocrine DisruptionSR-p530.7022.8%47.6%98.9%0.5621
CarcinogenicityCarcinogenicity0.6521.2%78.6%71.4%0.5028
Endocrine DisruptionNR-ER-LBD0.7025.0%43.5%98.2%0.4823
Endocrine DisruptionSR-ARE0.7022.5%54.3%93.9%0.4835
Endocrine DisruptionNR-PPAR-gamma0.7025.2%60.0%98.2%0.415
Clinical ToxicityClinical toxicity0.7020.8%40.0%96.4%0.405
CardiotoxicityCardiotoxicity-300.8026.5%83.9%55.0%0.3862
Endocrine DisruptionNR-ER0.7023.8%36.8%93.2%0.3557
Endocrine DisruptionSR-HSE0.7022.0%36.4%97.9%0.3411

Five endpoints rest on fewer than twenty measured actives; the measured active column is there so a reader can see which. Cardiotoxicity at 30 micromolar is the one endpoint that fails in the other direction, catching most of the actives and passing few of the inactives.

Eye corrosion is the one endpoint that answers perfectly, 100.0% caught and 100.0% passed at a required similarity of 0.65. It does so for 23.4% of compounds and rests on 62 measured actives, and its positive class is small reactive molecules, which are the easiest kind to match to a close neighbor. The fingerprint is folded to 1,024 bits, so distinct structures can share one. Read the score with the coverage and the count beside it.

accuracy and coverage across the endpoints
Every endpoint across the similarity sweep. Coverage falls as the threshold tightens on all of them, and accuracy rises across the sweep as a whole rather than at every step.

The reference sets behind them

CategoryEndpointRecordsUnique compounds
CYP450CYP1A29,6909,212
CYP450CYP2C1910,53010,095
CYP450CYP2C99,8419,405
CYP450CYP2D610,61810,201
CYP450CYP3A411,28810,887
CarcinogenicityCarcinogenicity1,0211,000
CardiotoxicityCardiotoxicity-11,5471,295
CardiotoxicityCardiotoxicity-101,5471,295
CardiotoxicityCardiotoxicity-301,5471,295
CardiotoxicityCardiotoxicity-51,5471,295
Clinical ToxicityClinical toxicity1,4301,242
Developmental and Reproductive ToxicityDevelopmental Toxicity218187
Developmental and Reproductive ToxicityReproductive Toxicity156146
Endocrine DisruptionNR-AR7,1186,873
Endocrine DisruptionNR-AR-LBD6,6296,410
Endocrine DisruptionNR-AhR6,4106,200
Endocrine DisruptionNR-ER6,0685,875
Endocrine DisruptionNR-ER-LBD6,8206,589
Endocrine DisruptionNR-PPAR-gamma6,3226,106
Endocrine DisruptionNR-aromatase5,7075,515
Endocrine DisruptionSR-ARE5,7125,535
Endocrine DisruptionSR-ATAD56,9316,706
Endocrine DisruptionSR-HSE6,3386,138
Endocrine DisruptionSR-MMP5,7005,511
Endocrine DisruptionSR-p536,6366,417
HepatotoxicityHepatotoxicity2,8892,805
Irritation and CorrosionEye Corrosion2,2422,200
Irritation and CorrosionEye Irritation5,1255,052
MutagenicityAmes Mutagenicity7,4856,875
Respiratory ToxicityRespiratory Toxicity1,3481,195

Across the 28 scored endpoints the table holds 149,224 measurements over 34,162 compounds, from 156,086 raw records before duplicate resolution. A measurement is one value for one compound on one endpoint. The compound total is lower than the sum of the unique compound column because a compound measured on several endpoints appears in several rows. The table lists 30 endpoints. Developmental Toxicity and Reproductive Toxicity are not scored and are not in these totals.

Where these data come from

Every endpoint on this page is public, and every measurement behind it was published by someone else. The links go to the source rather than to our copy of it.

SourceWhat it providesWhere
TOXRICThe 28 scored endpoints, from a curated collection of toxicity measurements spanning acute toxicity, the cytochromes, mutagenicity, carcinogenicity, cardiotoxicity, hepatotoxicity, irritation and the Tox21 nuclear receptor and stress response panels.toxric.bioinforai.tech
CATMoS, through the OPERA releaseThe rat oral LD50 measurements behind the acute traffic light, experimental values only.NIEHS OPERA
Tox21The original assay program behind the NR and SR endpoints in the table above.tripod.nih.gov/tox21
OpenADMET, CYP challengeThe CYP3A4 inhibition measurements on outside compounds behind the external reach result, from a public consortium release.openadmet.org
The Reverse Screen indexThe 33,642 indexed ligands behind the cross-family reach signal.reversescreen.ai

The toxpred package fetches both reference sets for you with toxpred fetch, and toxpred provenance prints the URL, the size and the sha256 of every file it took. The download page carries the same checksums for the files this site scores against.

Two of these thirty carry too few compounds to score against and are not offered: developmental toxicity and reproductive toxicity. The 28 that are scored are the ones above that floor.

Running a library through the score

The retrieval measures, the cross-family target preferences and the size descriptors combine into one score, fitted on 70% of the compounds and measured only on the 30% held back. The consortium predictions are evaluated separately and are not inputs to it. Put a library through it and the question is what the worst scoring tenth contains.

EndpointIn the libraryIn the flagged tenthFoldShare of all its actives
NR-AR-LBD2.8 in 10016.7 in 1006.060.4%
NR-AR4.1 in 10024.2 in 1006.059.5%
CYP2D613.4 in 10044.0 in 1003.332.8%
Clinical toxicity7.6 in 10022.9 in 1003.029.6%
CYP3A433.0 in 10081.3 in 1002.524.7%

Read a row as a pair. The tenth the score flags holds 16.7 actives in 100 at the androgen receptor ligand binding domain where the library it came from held 2.8, and that tenth carries 60.4% of every active in the set.

Discarding the worst scoring fifth rather than the tenth removes 64.1% of the androgen receptor ligand binding domain actives, 67.9% of the androgen receptor actives, 49.6% of the CYP2D6 inhibitors and 46.4% of the CYP3A4 inhibitors, against 20% for discarding at random.

What the score can buy is set by how rare the outcome is. Where half the library already carries the endpoint there is little to sort: hepatotoxicity moves from 49.9 in 100 to 83.5, and cardiotoxicity at 30 micromolar from 82.2 to 91.9. The method earns its place on the rare outcomes, which are also the ones a triage step is run to find.

enrichment in the flagged tenth, the discard curve, and a red amber green split
Running a library through the score, measured on compounds it was never fitted on. Left, out of every 100 compounds, how many are toxic in the library and how many in the tenth the score flags. Middle, discarding the worst scoring compounds, the share of toxic ones removed against the share of the library given up, with the diagonal marking what discarding at random achieves. Right, percent toxic in a red, amber and green split at the worst tenth, the next fifth and the remainder, with the line marking the library before any filtering.