Pasar al contenido principal

Resultados relacionados

Resultados totales (Incluyendo duplicados): 4
Encontrada(s) 1 página(s)

DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Biomass to energy: a machine learning model for optimum gasification pathways

  • Gil Matellanes, María Victoria
  • Jablonka, Kevin Maik
  • García López, Susana
  • Pevida García, Covadonga
  • Pevida García, Covadonga
Biomass is a highly versatile renewable resource for decarbonizing energy systems. Gasification is a promising conversion technology that can transform biomass into multiple energy carriers to produce heat, electricity, biofuels, or chemicals. At present, identifying the best gasification route for a given biomass relies on trial and error, which involves time-consuming experimentation that, given the wide range of biomass feedstocks available, slows down the deployment of the technology. Here, we use a supervised non-parametric machine-learning method, Gaussian process regression (GPR), that provides robust predictions when working with small datasets, to develop a model to find the optimal application of a particular biomass in gasification processes. Leave-one-out cross-validation (LOOCV) is used to validate the model's predictive performance. Our model can select the suitable gasification pathway from the characteristics of the biomass, and also identify the optimal operating conditions for a selected application of the produced gas. In addition, with this model, we can obtain insights into the relationships between biomass properties and gasification results, leading to a better understanding of the process. A relevant aspect of this work is that these results rely on a relatively small dataset, representative of those typically collected by research groups using different types of gasifiers worldwide. This study opens the path for future integration of such data, which would allow addressing the complexity of biomass and conversion process simultaneously. With this work, we aim to increase the flexibility of biomass gasification processes and promote the development of bioenergy technologies, considered crucial in the energy transition context., This work was carried out with financial support from the Spanish Agencia Estatal de Investigación (AEI) through Grant TED2021-131693B-I00 funded by MCIN/AEI/10.13039/501100011033 and by the “European Union NextGenerationEU/PRTR”, and from the Spanish National Research Council (CSIC) through Programme for internationalization i-LINK 2021 (Project LINKA20412). M. V. G. acknowledges support from the Spanish AEI through the Ramón y Cajal Grant RYC-2017-21937 funded by MCIN/AEI/10.13039/501100011033 and by “ESF Investing in your future”. We thank H. Mashhadimoslem for useful discussions, Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

14 examples of how LLMs can transform materials science and chemistry: a reflection on a large language model hackathon

  • Jablonka, Kevin Maik
  • Ai, Qianxiang
  • Al-Feghali, Alexander
  • Badhwar, Shruti
  • Bocarsly, Joshua D
  • Bran, Andres M
  • Bringuier, Stefan
  • Brinson, L Catherine
  • Choudhary, Kamal
  • Circi, Defne
  • Cox, Sam
  • de Jong, Wibe A
  • Evans, Matthew L
  • Gastellu, Nicolas
  • Genzling, Jerome
  • Gil Matellanes, María Victoria
  • Gupta, Ankur K
  • Hong, Zhi
  • Imran, Alishba
  • Kruschwitz, Sabine
  • Labarre, Anne
  • Lála, Jakub
  • Liu, Tao
  • Ma, Steven
  • Majumdar, Sauradeep
  • Merz, Garrett W
  • Moitessier, Nicolas
  • Moubarak, Elias
  • Mouriño, Beatriz
  • Pelkie, Brenden
  • Pieler, Michael
  • Ramos, Mayk Caldas
  • Ranković, Bojana
  • Rodriques, Samuel G
  • Sanders, Jacob N
  • Schwaller, Philippe
  • Schwarting, Marcus
  • Shi, Jiale
  • Smit, Berend
  • Smith, Ben E
  • Van Herck, Joren
  • Völker, Christoph
  • Ward, Logan
  • Warren, Sean
  • Weiser, Benjamin
  • Zhang, Sylvester
  • Zhang, Xiaoqi
  • Zia, Ghezal Ahmad
  • Scourtas, Aristana
  • Schmidt, K J
  • Foster, Ian
  • White, Andrew D
  • Blaiszik, Ben
Large-language models (LLMs) such as GPT-4 caught the interest of many scientists. Recent studies suggested that these models could be useful in chemistry and materials science. To explore these possibilities, we organized a hackathon. This article chronicles the projects built as part of this hackathon. Participants employed LLMs for various applications, including predicting properties of molecules and materials, designing novel interfaces for tools, extracting knowledge from unstructured data, and developing new educational applications. The diverse topics and the fact that working prototypes could be generated in less than two days highlight that LLMs will profoundly impact the future of our fields. The rich collection of ideas and projects also indicates that the applications of LLMs are not limited to materials science and chemistry but offer potential benefits to a wide range of scientific disciplines., We would like to specifically thank Jim Warren (NIST) for his contributions to discussions leading up to the hackathon and his participation as a judge during the event. We would also like to thank Anthony Costa and Christian Dallago (NVIDIA) for supporting the hackathon. B. B., I. T. F, and Z. H. acknowledge support from the the National Science Foundation awards #2226419 and #2209892. This work was performed under the following financial assistance award 70NANB19H005 from the U.S. Department of Commerce, National Institute of Standards and Technology as part of the Center for Hierarchical Materials Design (CHiMaD). K. J. S, A. S. acknowledge support from the the National Science Foundation award #1931306. K. M. J., S. M., J. v. H., X. Z., B. M., E. M., and B. S. were supported by the MARVEL National Centre for Competence in Research funded by the Swiss National Science Foundation (grant agreement ID 51NF40-182892) and the USorb-DAC Project, which is funded by a grant from The Grantham Foundation for the Protection of the Environment to RMI's climate tech accelerator program, Third Derivative. B. M. was further supported by the European Union's Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No. 945363. M. C. R., S. C., and A. D. W. were supported by the National Science Foundation and the National Institute of General Medical Sciences under Grant No. 1764415 and award number R35GM137966, respectively. Q. A.'s contribution to this work was supported by the National Center for Advancing Translational Sciences of the National Institutes of Health under award number U18TR004149. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health. M. V. G. acknowledges support from the Spanish National Research Council (CSIC) through the Programme for internationalization i-LINK 2021 (Project LINKA20412), and from the Spanish Agencia Estatal de Investigación (AEI) through the Grant TED2021-131693B-I00 funded by MCIN/AEI/10.13039/501100011033 and by the “European Union NextGenerationEU/PRTR” and through the Ramón y Cajal Grant RYC-2017-21937 funded by MCIN/AEI/10.13039/501100011033 and by “ESF Investing in your future”. The project (M. L. E., B. E. S. and J. D. B.) has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement 957189 (DOI: 10.3030/957189), the Battery Interface Genome – Materials Acceleration Platform (BIG-MAP), as an external stakeholder project. M. L. E. additionally thanks the BEWARE scheme of the Wallonia-Brussels Federation for funding under the European Commission's Marie Curie-Skłodowska Action (COFUND 847587). B. E. S. acknowledges support from the UK's Engineering and Physical Sciences Research Council (ESPRC). B. P. acknowledges support from the National Science Foundation through NSF-CBET Grant No. 1917340. The authors thank Phung Cheng Fei, Hassan Harb, and Vinayak Bhat for their helpful comments on this project. D. C. and L. C. B. thank NSF DGE-2022040 for the aiM NRT funding support. K. C. thank the National Institute of Standards and Technology for funding, computational, and data-management resources. Please note certain equipment, instruments, software, or materials are identified in this paper in order to specify the experimental procedure adequately. Such identification is not intended to imply recommendation or endorsement of any product or service by NIST, nor is it intended to imply that the materials or equipment identified are necessarily the best available for the purpose. A. K. G., G. W. M., A. I., and W. A. d. J. were supported by the U.S. Department of Energy, Office of Science, Basic Energy Sciences, Materials Sciences and Engineering Division under Contract No. DE-AC02-05CH11231, FWP No. DAC-LBL-Long, and by the U.S. Department of Energy, Office of Science, Office of High Energy Physics under Award Number DE-FOA-0002705. M. B, B. R., and P. S. were supported by the NCCR Catalysis (grant number 180544), a National Centre of Competence in Research funded by the Swiss National Science Foundation. S. G. R. and J. L. acknowledge the generous support of Eric and Wendy Schmidt, and the core funding of the Francis Crick Institute, which receives its funding from Cancer Research UK, the UK Medical Research Council, and the Wellcome Trust., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Assessment of fine-tuned large language models for real-world chemistry and material science applications

  • Van Herck, Joren
  • Gil Matellanes, María Victoria
  • Jablonka, Kevin Maik
  • Abrudan, Alex
  • Anker, Andy S
  • Asgari, Mehrdad
  • Blaiszik, Ben
  • Buffo, Antonio
  • Choudhury, Leander
  • Corminboeuf, Clemence
  • Daglar, Hilal
  • Elahi, Amir Mohammad
  • Foster, Ian T
  • Garcia, Susana
  • Garvin, Matthew
  • Godin, Guillaume
  • Good, Lydia L
  • Gu, Jianan
  • Xiao Hu, Noémie
  • Jin, Xin
  • Junkers, Tanja
  • Keskin, Seda
  • Knowles, Tuomas P J
  • Laplaza, Ruben
  • Lessona, Michele
  • Majumdar, Sauradeep
  • Mashhadimoslem, Hossein
  • McIntosh, Ruaraidh D
  • Moosavi, Seyed Mohamad
  • Mouriño, Beatriz
  • Nerli, Francesca
  • Pevida García, Covadonga
  • Poudineh, Neda
  • Rajabi-Kochi, Mahyar
  • Saar, Kadi L
  • Hooriabad Saboor, Fahimeh
  • Sagharichiha, Morteza
  • Schmidt, K J
  • Shi, Jiale
  • Simone, Elena
  • Svatunek, Dennis
  • Taddei, Marco
  • Tetko, Igor
  • Tolnai, Domonkos
  • Vahdatifar, Sahar
  • Whitmer, Jonathan
  • Wieland, D C Florian
  • Willumeit-Römer, Regine
  • Züttel, Andreas
  • Smit, Berend
The datasets and Jupyter Notebooks used in this work are available at https://github.com/JorenBE/GPT-Challenge., The current generation of large language models (LLMs) has limited chemical knowledge. Recently, it has been shown that these LLMs can learn and predict chemical properties through fine-tuning. Using natural language to train machine learning models opens doors to a wider chemical audience, as field-specific featurization techniques can be omitted. In this work, we explore the potential and limitations of this approach. We studied the performance of fine-tuning three open-source LLMs (GPT-J-6B, Llama-3.1-8B, and Mistral-7B) for a range of different chemical questions. We benchmark their performances against "traditional" machine learning models and find that, in most cases, the fine-tuning approach is superior for a simple classification problem. Depending on the size of the dataset and the type of questions, we also successfully address more sophisticated problems. The most important conclusions of this work are that, for all datasets considered, their conversion into an LLM fine-tuning training set is straightforward and that fine-tuning with even relatively small datasets leads to predictive models. These results suggest that the systematic use of LLMs to guide experiments and simulations will be a powerful technique in any research study, significantly reducing unnecessary experiments or computations., The research of J. V. H., and B. S. is supported by the Swiss Science Foundation through a Project Funding (214872) and Advanced Grant (216165). M. V. G. and C. P. gratefully acknowledge financial support from the Spanish Agencia Estatal de Investigación (AEI) through Grants TED2021-131693B-I00 (M. V. G. and C. P.) and CNS2022-135474 (M. V. G.), funded by MICIU/AEI/10.13039/501100011033 and by the European Union NextGenerationEU/PRTR. M. V. G. acknowledges support from the Spanish National Research Council (CSIC) through Programme for internationalization i-LINK 2023 (Project ILINK23047). M. V. G. acknowledges the access granted by the Galician Supercomputing Center (CESGA) to the FinisTerrae III supercomputer, funded by the Spanish Ministry of Science and Innovation, the Galician Government, and the European Regional Development Fund (ERDF), and the access granted by the CSIC to the Drago supercomputer. Parts of the work of K. M. J. were supported by the Carl Zeiss Foundation. S. G., M. G., N. P., B. S., and J. V. H. are partly supported by the USorb-DAC Project through a grant from The Grantham Foundation for the Protection of the Environment to RMI's climate tech accelerator program, Third Derivative. The work of A. S. A. is supported by Novo Nordisk Foundation grant NNF23OC0081359. S. M. M. and M. R. K. work is partly supported by grant number DSI-CGY3R1P16 from the Data Sciences Institute at the University of Toronto. M. A. expresses gratitude to the European Research Council (ERC) for evaluating the project with the reference number 101106377 titled “CLARIFIER” and accepting it for funding under the HORIZON TMA MSCA Postdoctoral Fellowships – European Fellowships. Furthermore, M. A. acknowledges the funding by UK Research and Innovation (UKRI) under the UK government's Horizon Europe funding guarantee (EP/Y023447/1; organization reference:101106377). L. L. G., A. A., and T. P. J. K. gratefully acknowledge funding from the European Research Council under the European Union's Horizon 2020 research and innovation program through the ERC grant DiProPhys (agreement ID 101001615) (L. L. G., A. A., T. P. J. K.). The National Institutes of Health Oxford-Cambridge Scholars Program (L. L. G.), the Cambridge Trust's Cambridge International Scholarship (L. L. G.), the Intramural Research Program of the National Institute of Diabetes and Digestive and Kidney Diseases at the National Institutes of Health (L. L. G.). The European Research Council under the European Union's Seventh Framework Programme (FP7/2007–2013; T. P. J. K.) and the Frances and Augustus Newman Foundation (T. P. J. K.). K. L. S. acknowledges funding from the Schmidt Science Fellowship in partnership with the Rhodes Trust and from St. John's College Research Fellowship programme. F. N. and M. T. thank the Italian MUR for provision of funding through the PRIN 2020 Project doMino (ref 2020P9KBKZ). The research of N. X. H. was supported by the NCCR MARVEL, a National Centre of Competence in Research, funded by the Swiss National Science Foundation (grant number 205602). B. M. acknowledges the European Union's Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement no. 945363. E. S. acknowledges the European Research Council (ERC) under the European Union's Horizon 2020 research and innovation programme (grant agreement no. 949229, CryForm)., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

From text to insight: large language models for chemical data extraction

  • Schilling-Wilhelmi, Mara
  • Ríos García, Martiño
  • Shabih, Sherjeel
  • Gil Matellanes, María Victoria
  • Miret, Santiago
  • Koch, Christoph T
  • Márquez, José A
  • Jablonka, Kevin Maik
The online book is available at https://matextract.pub for which the source code is available at https://github.com/lamalab-org/matextract-book and archived at https://doi.org/10.5281/zenodo.14249541., The vast majority of chemical knowledge exists in unstructured natural language, yet structured data is crucial for innovative and systematic materials design. Traditionally, the field has relied on manual curation and partial automation for data extraction for specific use cases. The advent of large language models (LLMs) represents a significant shift, potentially enabling non-experts to extract structured, actionable data from unstructured text efficiently. While applying LLMs to chemical and materials science data extraction presents unique challenges, domain knowledge offers opportunities to guide and validate LLM outputs. This tutorial review provides a comprehensive overview of LLM-based structured data extraction in chemistry, synthesizing current knowledge and outlining future directions. We address the lack of standardized guidelines and present frameworks for leveraging the synergy between LLMs and chemical expertise. This work serves as a foundational resource for researchers aiming to harness LLMs for data-driven chemical research. The insights presented here could significantly enhance how researchers across chemical disciplines access and utilize scientific information, potentially accelerating the development of novel compounds and materials for critical societal needs., The research of M. S.-W. and K. M. J. was supported by the Carl-Zeiss Foundation as well as Intel and Merck via the AWASES programme. S. S., C. T. K., J. A. M., and K. M. J. are part of the NFDI consortium FAIRmat funded by the Deutsche Forschungsgemeinschaft (DFG, German Research Foundation) – project 460197019. M. R. G. and M. V. G. acknowledge financial support from the Spanish Agencia Estatal de Investigación (AEI) through grants TED2021-131693B-I00 and CNS2022-135474, funded by MICIU/AEI/10.13039/501100011033 and by the European Union NextGenerationEU/PRTR, and support from the Spanish National Research Council (CSIC) through Programme for internationalization i-LINK 2023 (Project ILINK23047), Peer reviewed