--- title: "FAbCon: Can antibody-specific generative foundation model facilitate antibody sequence understanding?" description: "FAbCon: Antibody-specific generative language model facilitating antibody sequence understanding and design with superior binding prediction." image: https://info.genophore.com/hubfs/Thumbnail%20Themes%20(28).svg --- [Skip to content](https://info.genophore.com/posts/fabcon-can-antibody-specific-generative-foundation-model-facilitate-antibody-sequence-understanding#main-content) [![Genophore](https://info.genophore.com/hubfs/Imported%20sitepage%20images/203149784d2ad8223028.svg "Genophore")](https://www.genophore.com) - Products - [Molecular Biology Suite](https://genophore.com/products/molecular_biology_suite/) - [Protein Sciences and Antibody Discovery](https://genophore.com/products/protein_sciences_and_antibody_discovery/) - [Structural Enablement](https://genophore.com/products/structural_enablement/) - [Connecting Biological and Chemical Knowledge](https://genophore.com/products/connecting_biological_and_chemical_knowledge/) - [Electronic Lab Notebook](https://genophore.com/products/electronic_lab_notebook/) - Technologies - [Data and Sequence Visualization](https://genophore.com/technologies/data_and_sequence_visualization/) - [Protein and DNA Parts Builder](https://genophore.com/technologies/protein_and_dna_parts_builder/) - [Workflows Builder](https://genophore.com/technologies/workflows_builder/) - [Customizable Data Structures](https://genophore.com/technologies/customizable_data_structures/) - Solutions - [Biopharmaceuticals & Biotech R&D](https://genophore.com/technologies/biotech_research_and_development/) - [Life Sciences](https://genophore.com/technologies/life_sciences/) - [Pricing](https://genophore.com/pricing/) - [Tools](https://info.genophore.com/tools) - [Blog](https://info.genophore.com/blog) - [Contact Us](https://genophore.com/contact/) - [Try Now](https://www.genophore.com/app) - [Protein Design](https://info.genophore.com/posts/tag/protein-design) - [Generative Design](https://info.genophore.com/posts/tag/generative-design) - [Drug Development](https://info.genophore.com/posts/tag/drug-development) - [Biologics](https://info.genophore.com/posts/tag/biologics) # FAbCon: Can antibody-specific generative foundation model facilitate antibody sequence understanding? May 27, 2024 ![Genophore](https://info.genophore.com/hubfs/Genophore_Profile_Logo_2024.png) [Genophore](https://info.genophore.com/posts/author/genophore) FAbCon: Can antibody-specific generative foundation model facilitate antibody sequence understanding? A team led by Jacob Galson has just released FAbCon, a set of generative large language models (LLMs) for antibody binding prediction and design. The FAbCon LLM is a specialized model that comprises 2.4 billion parameters based on Falcon, an LLM for natural language processing applications. The collection of human antibodies forms a uniquely diverse and large class of proteins that caters for the wide range of antigens that the human body would be exposed to.  The capability to decode the language of human antibodies would enable deeper understanding of diseases and the consequent ability to treat them in a targeted manner. LLMs offers the ideal capacity to analyze and encode the patterns in the large antibody sequence corpus, with the possibility to scale performance with model size. FAbCon is a decoder-only antibody-specific LLM comprising more than 2 billion parameters built on Falcon, an LLM for natural language processing. FAbCon also shares some similarity to other state-of-the-art generative protein language models like ProGen2 and ProtGPT2.   ![FABCon](https://info.genophore.com/hs-fs/hubfs/FABCon.png?width=800&height=1000&name=FABCon.png) was pre-trained on paired (heavy and light chains in a single sequence) and unpaired (heavy or light chain only) antibody sequences, following which the model exhibited a mature representation of antibody sequences that enabled its utility for diverse antibody modeling and design tasks. FAbCon consists of three models of varying number of parameters: 1️⃣ FAbCon-small (144 million parameters) 2️⃣ FAbCon-medium (297 million parameters) 3️⃣ FAbConlarge (2.4 billion parameters) The models have been specifically evaluated for antigen binding prediction and antibody design capabilities. All the models can handle heavy-chain only, light-chain only, and paired chain inputs. 💉 The FAbCon models were fine-tuned for binding predictions on datasets of three antigens: HER2, SARS-CoV2 spike peptide, and IL-6. FAbCon-large demonstrated the best performance based on AUPR and AUROC metrics, outperforming existing models. 🏃‍♂️ On generative *de novo* antibody design task, FAbCon-large surpasses ProGen2-OAS based on OASis score, a measure of humanness of generated antibodies. ❓ How does FAbCon’s generative capability for designing new antibodies compare with traditional biologics discovery methods in terms of speed, cost, and success rate in identifying viable manufacturable therapeutic candidates? ❔ What are the specific challenges that need to be addressed to integrate this model effectively into the current drug discovery pipeline? Resources Paper: [A generative foundation model for antibody sequence understanding](https://www.biorxiv.org/content/10.1101/2024.05.22.594943v1) Models (huggingface): [https://huggingface.co/alchemab](https://huggingface.co/alchemab)    Blog Post ## Related Articles [![Colorful and artistic image of a bispecific antibody with text indicating the content of the article.](https://info.genophore.com/hubfs/Thumbnail%20Themes%20(8).svg)](https://info.genophore.com/posts/igfold-how-deep-learning-on-0.5-billion-natural-antibody-sequence-and-graph-networks-can-facilitate-fast-antibodies-structure-prediction) ### [IgFold: How deep learning on 0.5 billion natural antibody sequences and graph networks can facilitate fast antibodies structure prediction](https://info.genophore.com/posts/igfold-how-deep-learning-on-0.5-billion-natural-antibody-sequence-and-graph-networks-can-facilitate-fast-antibodies-structure-prediction) June 23, 2024 [Protein Design](https://info.genophore.com/posts/tag/protein-design) [Structure Prediction](https://info.genophore.com/posts/tag/structure-prediction) [Generative Design](https://info.genophore.com/posts/tag/generative-design) [![](https://info.genophore.com/hubfs/Thumbnail%20Themes%20(14).svg)](https://info.genophore.com/posts/antifold-superior-structure-based-antibody-sequence-design-for-enhanced-cdr-recovery) ### [AntiFold: Superior Structure-Based Antibody Sequence Design for Enhanced CDR Recovery](https://info.genophore.com/posts/antifold-superior-structure-based-antibody-sequence-design-for-enhanced-cdr-recovery) May 19, 2024 [ML/AI](https://info.genophore.com/posts/tag/ml-ai) [Drug Development](https://info.genophore.com/posts/tag/drug-development) [Biologics](https://info.genophore.com/posts/tag/biologics) [![](https://info.genophore.com/hubfs/ai-methods-in-antibody-presiction.svg)](https://info.genophore.com/posts/advanced-methods-in-antibody-structure-prediction-and-de-novo-generation) ### [AI Methods in Antibody Structure Prediction and De Novo Generation](https://info.genophore.com/posts/advanced-methods-in-antibody-structure-prediction-and-de-novo-generation) May 17, 2024 [Protein Design](https://info.genophore.com/posts/tag/protein-design) [Generative Design](https://info.genophore.com/posts/tag/generative-design) [Biologics](https://info.genophore.com/posts/tag/biologics) ##### Genophore - [Contact Us](https://genophore.com/contact/) - contact@genophore.com 8 The Green Dover DE 19901 United States [Follow us on LinkedIn](https://www.linkedin.com/company/genophore-inc/) [Follow us on Twitter](https://twitter.com/Genophore_Inc/) ##### Products - [Molecular Biology Suite](https://genophore.com/products/molecular_biology_suite/) - [Protein Sciences and Antibody Discovery](https://genophore.com/products/protein_sciences_and_antibody_discovery/) - [Structural Enablement](https://genophore.com/products/structural_enablement/) - [Connecting Biological and Chemical Knowledge](https://genophore.com/products/connecting_biological_and_chemical_knowledge/) - [Electronic Lab Notebook](https://genophore.com/products/electronic_lab_notebook/) ##### Technologies - [Data and Sequence Visualization](https://genophore.com/technologies/data_and_sequence_visualization/) - [Protein and DNA Parts Builder](https://genophore.com/technologies/protein_and_dna_parts_builder/) - [Workflows Builder](https://genophore.com/technologies/workflows_builder/) - [Customizable Data Structures](https://genophore.com/technologies/customizable_data_structures/) ##### Solutions - [Biopharmacuticals and Biotech R&D](https://genophore.com/technologies/biotech_research_and_development/) - [Life Sciences](https://genophore.com/technologies/life_sciences/) --- ©2024 Genophore - [Terms of Use](https://genophore.com/terms/) - [Privacy Policy](https://genophore.com/privacy/) ```json { "@context" : "https://schema.org", "@type" : "BlogPosting", "author" : { "@type" : "Person", "name" : "Genophore", "url" : "https://info.genophore.com/posts/author/genophore" }, "dateModified" : "2024-07-06T18:39:25.239Z", "datePublished" : "2024-05-27T18:38:00.000Z", "headline" : "FAbCon: Can antibody-specific generative foundation model facilitate antibody sequence understanding?", "image" : [ "https://info.genophore.com/hubfs/Thumbnail%20Themes%20(28).svg" ], "mainEntityOfPage" : { "@id" : "https://info.genophore.com/posts/fabcon-can-antibody-specific-generative-foundation-model-facilitate-antibody-sequence-understanding", "@type" : "WebPage" }, "publisher" : { "@type" : "Organization", "logo" : { "@type" : "ImageObject" } } } ```