- Ballester, Francesc
- Errea, Ion
- Vergniory, Maia G.
- Schoop, Leslie M.
Precise orientation of symmetry-mismatched epilayers on van der Waals (vdW) substrates via heteroepitaxy has commonly been achieved through surface treatment processes to accommodate weak interlayer registry and bonding strength, thereby limiting the range of material combinations for heterostructure design. In this study, we investigate the influence of lattice instabilities in a structurally modulated vdW TaCo2Te2 substrate on the growth and alignment of a symmetry-mismatched bulk CoxTey epilayer using in situ heating in a transmission electron microscope (TEM). We show that a Peierls-like lattice instability occurs in TaCo2Te2 at a transition temperature of ∼523 K, which was corroborated by phonon calculations. Postheat-treated samples reveal a thermally induced surface diffusion process and the dominant lateral growth of the CoxTey epilayer on the TaCo2Te2 vdW layers, as observed in cross-sectional TEM images. Temperature-dependent selected area electron diffraction (SAED) patterns reveal that the quasi-vdW CoxTey/TaCo2Te2 heterointerface acquires directional locking by aligning larger interlayer lattice mismatch along the lattice instability axis of TaCo2Te2, while preserving a strong lattice matching along the orthogonal direction. This heterostructure exhibits precise interlayer registry with one-dimensional lattice incommensuration along the lattice instability axis, resulting from structural distortion to accommodate lattice-mismatch strain. Moreover, the interfacial reconstruction of TaCo2Te2 back to the distorted phase stabilizes the lattice-locking of the quasi-vdW heterointerface at elevated temperatures. These findings encourage the expansion of material diversity for designing and predicting multidimensional heterostructures by leveraging lattice instabilities to guide epitaxy., This project is supported by the Gordon and Betty Moore Foundation’s EPIQS initiative through award number GBMF9064 (supported L.M.S. and N.M., R.S., S.C., and F.Y.), the Princeton Center for Complex Materials (PCCM) and the NSF-MRSEC program (supports. L.M.S., F.Y. and S.W.) (MRSEC; DMR-2011750) and the Air Force Office of Scientific Research under Grants No. FA9550-24-1-0110 (supports L.M.S., K.S.B., R.S., and V.M.P.). N.M., F.Y., G.C., N.Y., and L.M.S. acknowledge the sample characterization of the Imaging and Analysis Center (IAC) at Princeton University, partially supported by the Princeton Center for Complex Materials (PCCM) and the NSF-MRSEC program (MRSEC; DMR-2011750). S.W. acknowledges support from Gordon and Betty Moore Foundation’s EPiQS Initiative grant no. GBMF11946. B.J. acknowledges support by the Hong Kong RGC (C6033-22G) and the Croucher Foundation (Grant No. CIA22SC02). C.C. acknowledges support from the Tin Ka Ping Foundation. S.B.L. and G.C. are supported by the National Science Foundation Graduate Research Fellowship Program under Grant No. DGE-2039656. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the National Science Foundation. I.E. acknowledges funding from the Spanish Ministry of Science and Innovation (Grant No. PID2022-142861NA-I00) and the Department of Education, Universities and Research of the Basque Government and the University of the Basque Country (Grant No. IT1527-22). M.G.V. received financial support from the Canada Excellence Research Chairs Program for Topological Quantum Matter. M.G.V. and F.B. thank the support from the Spanish Ministerio de Ciencia e Innovacion grant PID2022-142008NB-I00 and the Ministry for Digital Transformation and of Civil Service of the Spanish Government through the QUANTUM ENIA project call-Quantum Spain project, and by the European Union through the Recovery, Transformation and Resilience Plan-NextGenerationEU within the framework of the Digital Spain 2026 Agenda. This project was partially supported by the European Research Council (ERC) under the European Union’s Horizon 2020 Research and Innovation Programme (Grant Agreement No. 101020833). K.W. and T.T. acknowledge support from the JSPS KAKENHI (Grant Numbers 21H05233 and 23H02052), the CREST (JPMJCR24A5), JST and World Premier International Research Center Initiative (WPI), MEXT, Japan., Peer reviewed