{"url":"/method/palm","slug":"palm","name":"PaLM","full_name":"Pathways Language Model","full_name_withheld":false,"description_markdown":"**PaLM** (**Pathways Language Model**) uses a standard Transformer model architecture (Vaswani et al., 2017) in a decoder-only setup (i.e., each timestep can only attend to itself and past timesteps), with several modifications. PaLM is trained as a 540 billion parameter, densely activated, autoregressive Transformer on 780 billion tokens. PaLM leverages Pathways (Barham et al., 2022), which enables highly efficient training of very large neural networks across thousands of accelerator chips.\r\n\r\nImage credit: [PaLM: Scaling Language Modeling with Pathways](https://paperswithcode.com/paper/palm-scaling-language-modeling-with-pathways-1)","description_state":"present","introduced_year":null,"introduced_by":{"title":null,"paper":null,"first_author":null,"n_authors":0,"url_abs":null,"archive_paper_url":null},"source":{"url":"https://arxiv.org/abs/2204.02311v5","title":"PaLM: Scaling Language Modeling with Pathways","url_on_a_paper_host":true},"code_snippet_url":null,"code_snippet_url_on_a_code_host":false,"categories":[{"area":"Natural Language Processing","area_id":"natural-language-processing","collection":"Transformers","url":"/methods/category/transformers","pwc_aliases":[]}],"n_papers_tagged":151,"archive_num_papers":null,"papers_newest_first":[{"paper":null,"title":"Canny2Palm: Realistic and Controllable Palmprint Generation for Large-scale Pre-training","date":"2025-05-08","arxiv_id":"2505.04922","n_code_links":0,"syntology":null},{"paper":null,"title":"Evaluation of UAV-Based RGB and Multispectral Vegetation Indices for Precision Agriculture in Palm Tree Cultivation","date":"2025-05-06","arxiv_id":"2505.07840","n_code_links":0,"syntology":null},{"paper":"/paper/diff-palm-realistic-palmprint-generation-with","title":"Diff-Palm: Realistic Palmprint Generation with Polynomial Creases and Intra-Class Variation Controllable Diffusion Models","date":"2025-03-24","arxiv_id":"2503.18312","n_code_links":1,"syntology":null},{"paper":null,"title":"Enhancing Hand Palm Motion Gesture Recognition by Eliminating Reference Frame Bias via Frame-Invariant Similarity Measures","date":"2025-03-14","arxiv_id":"2503.11352","n_code_links":0,"syntology":null},{"paper":null,"title":"Robust Palm-Vein Recognition Using the MMD Filter: Improving SIFT-Based Feature Matching","date":"2025-03-03","arxiv_id":"2503.01612","n_code_links":0,"syntology":null},{"paper":"/paper/deep-convolutional-neural-networks-for-palm","title":"Deep Convolutional Neural Networks for Palm Fruit Maturity Classification","date":"2025-02-27","arxiv_id":"2502.20223","n_code_links":1,"syntology":null},{"paper":null,"title":"ILACS-LGOT: A Multi-Layer Contrast Enhancement Approach for Palm-Vein Images","date":"2025-02-26","arxiv_id":"2502.19456","n_code_links":0,"syntology":null},{"paper":null,"title":"Detection and Geographic Localization of Natural Objects in the Wild: A Case Study on Palms","date":"2025-02-18","arxiv_id":"2502.13023","n_code_links":0,"syntology":null},{"paper":null,"title":"Human fields and their impact on brain waves A pilot study","date":"2025-02-04","arxiv_id":"2502.01939","n_code_links":0,"syntology":null},{"paper":null,"title":"Genomic Analysis of Date Palm Fruit Size Traits and Identification of Candidate Genes through GWAS","date":"2025-01-21","arxiv_id":"2501.11831","n_code_links":0,"syntology":null},{"paper":null,"title":"Computer Vision-Driven Gesture Recognition: Toward Natural and Intuitive Human-Computer","date":"2024-12-24","arxiv_id":"2412.18321","n_code_links":0,"syntology":null},{"paper":null,"title":"Coconut Palm Tree Counting on Drone Images with Deep Object Detection and Synthetic Training Data","date":"2024-12-16","arxiv_id":"2412.11949","n_code_links":0,"syntology":null},{"paper":null,"title":"Assessing Personalized AI Mentoring with Large Language Models in the Computing Field","date":"2024-12-11","arxiv_id":"2412.08430","n_code_links":0,"syntology":null},{"paper":null,"title":"The Performance of the LSTM-based Code Generated by Large Language Models (LLMs) in Forecasting Time Series Data","date":"2024-11-27","arxiv_id":"2411.18731","n_code_links":0,"syntology":null},{"paper":"/paper/training-and-evaluating-language-models-with","title":"Training and Evaluating Language Models with Template-based Data Generation","date":"2024-11-27","arxiv_id":"2411.18104","n_code_links":1,"syntology":{"ran":2,"of":4,"unverified":2,"pointer_only":4}},{"paper":null,"title":"Evaluating Gender Bias in Large Language Models","date":"2024-11-14","arxiv_id":"2411.09826","n_code_links":0,"syntology":null},{"paper":"/paper/a-comprehensive-survey-of-small-language","title":"A Comprehensive Survey of Small Language Models in the Era of Large Language Models: Techniques, Enhancements, Applications, Collaboration with LLMs, and Trustworthiness","date":"2024-11-04","arxiv_id":"2411.03350","n_code_links":1,"syntology":null},{"paper":"/paper/exploring-the-edges-of-latent-state-clusters","title":"Exploring the Edges of Latent State Clusters for Goal-Conditioned Reinforcement Learning","date":"2024-11-03","arxiv_id":"2411.01396","n_code_links":1,"syntology":null},{"paper":null,"title":"Can LLMs make trade-offs involving stipulated pain and pleasure states?","date":"2024-11-01","arxiv_id":"2411.02432","n_code_links":0,"syntology":null},{"paper":null,"title":"When Machine Unlearning Meets Retrieval-Augmented Generation (RAG): Keep Secret or Forget Knowledge?","date":"2024-10-20","arxiv_id":"2410.15267","n_code_links":0,"syntology":null},{"paper":"/paper/real-time-localization-and-bimodal-point","title":"Real-Time Localization and Bimodal Point Pattern Analysis of Palms Using UAV Imagery","date":"2024-10-14","arxiv_id":"2410.11124","n_code_links":1,"syntology":null},{"paper":"/paper/supercorrect-supervising-and-correcting","title":"SuperCorrect: Supervising and Correcting Language Models with Error-Driven Insights","date":"2024-10-11","arxiv_id":"2410.09008","n_code_links":2,"syntology":{"ran":0,"of":1,"unverified":1,"pointer_only":1}},{"paper":null,"title":"Diversity of Thought Elicits Stronger Reasoning Capabilities in Multi-Agent Debate Frameworks","date":"2024-10-10","arxiv_id":"2410.12853","n_code_links":0,"syntology":null},{"paper":null,"title":"Proof Automation with Large Language Models","date":"2024-09-22","arxiv_id":"2409.14274","n_code_links":0,"syntology":null},{"paper":null,"title":"RobotFingerPrint: Unified Gripper Coordinate Space for Multi-Gripper Grasp Synthesis and Transfer","date":"2024-09-22","arxiv_id":"2409.14519","n_code_links":0,"syntology":null},{"paper":null,"title":"Deep Learning Techniques for Hand Vein Biometrics: A Comprehensive Review","date":"2024-09-11","arxiv_id":"2409.07128","n_code_links":0,"syntology":null},{"paper":null,"title":"3D Whole-body Grasp Synthesis with Directional Controllability","date":"2024-08-29","arxiv_id":"2408.16770","n_code_links":0,"syntology":null},{"paper":null,"title":"A Survey of Large Language Models for European Languages","date":"2024-08-27","arxiv_id":"2408.15040","n_code_links":0,"syntology":null},{"paper":"/paper/new-spectral-imaging-biomarkers-for-sepsis","title":"New spectral imaging biomarkers for sepsis and mortality in intensive care","date":"2024-08-19","arxiv_id":"2408.09873","n_code_links":1,"syntology":null},{"paper":null,"title":"GAP9Shield: A 150GOPS AI-capable Ultra-low Power Module for Vision and Ranging Applications on Nano-drones","date":"2024-06-27","arxiv_id":"2407.13706","n_code_links":0,"syntology":null}],"papers_shown":30,"tasks":[{"task":"/task/language-modelling","name":"Language Modelling","papers":24},{"task":"/task/question-answering","name":"Question Answering","papers":17},{"task":"/task/language-modeling","name":"Language Modeling","papers":16},{"task":"/task/in-context-learning","name":"In-Context Learning","papers":10},{"task":"/task/large-language-model","name":"Large Language Model","papers":9},{"task":"/task/math","name":"Math","papers":9},{"task":"/task/text-generation","name":"Text Generation","papers":8},{"task":"/task/gsm8k","name":"GSM8K","papers":7},{"task":"/task/retrieval","name":"Retrieval","papers":7},{"task":"/task/common-sense-reasoning","name":"Common Sense Reasoning","papers":6},{"task":"/task/few-shot-learning","name":"Few-Shot Learning","papers":6},{"task":"/task/mathematical-reasoning","name":"Mathematical Reasoning","papers":6},{"task":"/task/multi-task-language-understanding","name":"Multi-task Language Understanding","papers":6},{"task":"/task/decoder","name":"Decoder","papers":5},{"task":"/task/diversity","name":"Diversity","papers":5},{"task":"/task/natural-language-inference","name":"Natural Language Inference","papers":5},{"task":"/task/natural-language-understanding","name":"Natural Language Understanding","papers":5},{"task":"/task/model","name":"model","papers":5},{"task":"/task/arithmetic-reasoning","name":"Arithmetic Reasoning","papers":4},{"task":"/task/coreference-resolution","name":"Coreference Resolution","papers":4}],"tasks_shown":20,"n_tasks":183,"usage_by_year":[{"year":"2022","papers":21},{"year":"2023","papers":65},{"year":"2024","papers":55},{"year":"2025","papers":10}],"row_source":"embedded","archive":{"source":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","archive_url":"https://paperswithcode.com/method/palm"},"syntology_read_at":"2026-09-24T18:15:14+00:00"}