1.

A 9-million-parameter neural network trained on one billion low-resolution quantum chemistry examples cut its error from 285 meV to 32 meV — a 9x improvement from data alone, with zero architectural changes. The catch: the data is 360 meV less accurate than the models it's supposed to replace, and nobody knows what that bias does to the fine-tuned results.

2.

Molecular ML is stuck at 20 million examples — NLP and CV hit billions

• QM9 has 133.9k graphs; PCQ has 3.38M; ANI-1 has 20M conformers — all orders of magnitude below the billions that enabled foundation models in language and vision
• DFT labels are the bottleneck: PCQ took ~2 years on CPU supercomputers; QM1B took 40,000 IPU hours, roughly 5 days
• Prior DFT datasets were all generated on CPUs — no hardware acceleration was used to create any of them

3.

IPUs accelerate DFT by 2.8x and enable MIMD parallelism

• IPUs have 940MB on-chip memory with 12–65TB/s bandwidth, enough to run small DFT computations without hitting slow off-chip RAM
• MIMD parallelism lets all 8,832 IPU threads independently compute electron repulsion integrals (INT2E calls) that SIMD hardware struggles with
• On a single IPU POD16, PySCF IPU achieves 228 DFTs/sec versus 82 DFTs/sec for standard PySCF — a 2.8x speedup

4.

Float32 DFT is 100x more accurate than the neural networks it trains

• PySCF IPU in float32 versus PySCF in float64 yields 0.2 meV MAE for HOMO-LUMO gap on converged molecules — 100x smaller than SchNet's 20–70 meV errors
• Libcint runs ~6x faster in float32 on IPUs because the hardware accelerates float32 directly instead of emulating float64 in software
• The authors argue that "our errors just have to be below that of NNs" — a pragmatic threshold, not a proof of correctness

5.

QM1B trades DFT accuracy for 50x more data

• ETKDG conformer generation replaces structure optimization, yielding 50x more examples per molecule while relying on RDKit to explore conformational space
• STO-3G basis set versus 6-31G* shows 360 meV MAE disagreement — 8x chemical accuracy (43 meV) and 5.7x SchNet's 63 meV error on QM9
• QM1B contains 1.09M SMILES strings from GDB11 with 9–11 heavy atoms, generating 1 billion conformers across 305.8M (9-atom), 568.7M (10-atom), and 205.4M (11-atom) subsets

6.

SchNet 9M improves 9x from data alone — then hits a wall

• Validation MAE drops from 285 meV at 100k samples to 32 meV at 500M samples, with no architectural changes or inductive biases added
• Training and validation MAE overlap at larger scales, indicating underfitting — the model is too small for the data, not the data too small for the model
• Pretraining on QM1B then fine-tuning on QM9 improves validation MAE from 54.13 meV to 30.2 meV, but the fine-tuning subset (88k molecules) excludes any SMILES strings present in GDB11 to prevent leakage

7.

The data is 360 meV wrong — and the fine-tuning result may be measuring that error, not the model's improvement

• QM1B's labels disagree with a more accurate DFT configuration by 360 meV, 8x chemical accuracy and 5.7x SchNet's own error on QM9 — the "low-resolution" data is systematically biased, not merely noisy
• The fine-tuning gain from 54.13 meV to 30.2 meV is measured on a subset of QM9 (88k molecules) that was explicitly chosen to avoid SMILES strings present in GDB11 — the fine-tuning may be correcting the low-resolution bias rather than transferring quantum chemistry knowledge
• The authors themselves warn that "it remains an open problem how pretraining on 1B such low-resolution conformers may bias a Neural Network subsequently fine-tuned on a smaller but more accurate dataset" — the central claim of the paper is a conjecture, not a demonstrated result

8.

The bias is the point — QM1B is a calibration instrument, not a production dataset

• Both the paper's thesis and the counter-argument assume QM1B's value depends on the accuracy of its labels; they share the hidden premise that a dataset's quality is measured by how close it comes to ground truth
• QM1B's real contribution is the first open-source, hardware-accelerated DFT data generator that lets researchers jointly iterate on dataset creation and model training — the 360 meV bias is not a bug but a controlled variable in a new experimental design space
• The fine-tuning result, even if it's bias correction, proves the pipeline works: a model trained on low-resolution data can be fine-tuned on high-resolution data and still outperform a model trained from scratch — the question is not whether QM1B is accurate enough, but whether the pretraining-then-fine-tuning paradigm transfers at all, and the answer is yes