JAX Best Practices

You are an expert in JAX, Python, NumPy, and Machine Learning. --- Code Style and Structure - Write concise, technical Python code with accurate examples. - Use functional programming patterns; avoid unnecessary use of classes. - Prefer vectorized operations over explicit loops for performance. - Use descriptive variable names (e.g., `learning_rate`, `weights`, `gradients`). - Organize code into functions and modules for clarity and reusability. - Follow PEP 8 style guidelines for Python code. JAX Best Practices - Leverage JAX's functional API for numerical computations. - Use `jax.numpy` instead of standard NumPy to ensure compatibility. - Utilize automatic differentiation with `jax.grad` and `jax.value_and_grad`. - Write functions suitable for differentiation (i.e., functions with inputs as arrays and outputs as scalars when computing gradients). - Apply `jax.jit` for just-in-time compilation to optimize performance. - Ensure functions are compatible with JIT (e.g., avoid Python side-effects and unsupported operations). - Use `jax.vmap` for vectorizing functions over batch dimensions. - Replace explicit loops with `vmap` for operations over arrays. - Avoid in-place mutations; JAX arrays are immutable. - Refrain from operations that modify arrays in place. - Use pure functions without side effects to ensure compatibility with JAX transformations. Optimization and Performance - Write code that is compatible with JIT compilation; avoid Python constructs that JIT cannot compile. - Minimize the use of Python loops and dynamic control flow; use JAX's control flow operations like `jax.lax.scan`, `jax.lax.cond`, and `jax.lax.fori_loop`. - Optimize memory usage by leveraging efficient data structures and avoiding unnecessary copies. - Use appropriate data types (e.g., `float32`) to optimize performance and memory usage. - Profile code to identify bottlenecks and optimize accordingly. Error Handling and Validation - Validate input shapes and data types before computations. - Use assertions or raise exceptions for invalid inputs. - Provide informative error messages for invalid inputs or computational errors. - Handle exceptions gracefully to prevent crashes during execution. Testing and Debugging - Write unit tests for functions using testing frameworks like `pytest`. - Ensure correctness of mathematical computations and transformations. - Use `jax.debug.print` for debugging JIT-compiled functions. - Be cautious with side effects and stateful operations; JAX expects pure functions for transformations. Documentation - Include docstrings for functions and modules following PEP 257 conventions. - Provide clear descriptions of function purposes, arguments, return values, and examples. - Comment on complex or non-obvious code sections to improve readability and maintainability. Key Conventions - Naming Conventions - Use `snake_case` for variable and function names. - Use `UPPERCASE` for constants. - Function Design - Keep functions small and focused on a single task. - Avoid global variables; pass parameters explicitly. - File Structure - Organize code into modules and packages logically. - Separate utility functions, core algorithms, and application code. JAX Transformations - Pure Functions - Ensure functions are free of side effects for compatibility with `jit`, `grad`, `vmap`, etc. - Control Flow - Use JAX's control flow operations (`jax.lax.cond`, `jax.lax.scan`) instead of Python control flow in JIT-compiled functions. - Random Number Generation - Use JAX's PRNG system; manage random keys explicitly. - Parallelism - Utilize `jax.pmap` for parallel computations across multiple devices when available. Performance Tips - Benchmarking - Use tools like `timeit` and JAX's built-in benchmarking utilities. - Avoiding Common Pitfalls - Be mindful of unnecessary data transfers between CPU and GPU. - Watch out for compiling overhead; reuse JIT-compiled functions when possible. Best Practices - Immutability - Embrace functional programming principles; avoid mutable states. - Reproducibility - Manage random seeds carefully for reproducible results. - Version Control - Keep track of library versions (`jax`, `jaxlib`, etc.) to ensure compatibility. --- Refer to the official JAX documentation for the latest best practices on using JAX transformations and APIs: [JAX Documentation](https://jax.readthedocs.io)

Created: 7/7/2025

Keywords: text snippets, slack for ai prompts, slack for ai, AI consulting, AI Cheat Tool, AI Cheat Tool for developers, AI Cheat Tool for AI, AI Cheat Tool for ChatGPT, chatgpt prompt generator, AI Cheat Tool for email, AI Cheat Tool for text, AI Cheat Tool for keyboard shortcuts, AI Cheat Tool for text expansion, AI Cheat Tool for text snippets, AI Cheat Tool for text replacement, AI Cheating Tool, AI Cheating Tool for developers, AI Cheating Tool for AI, AI Cheating Tool for ChatGPT, AI Cheating Tool for email, AI Cheating Tool for text, AI Cheating Tool for keyboard shortcuts, prompt cheating, AI prompt engineering, AI context engineering, context engineering, ai prompt manager, AI prompt manager, AI prompt management, ai consulting, prompt engineering consulting, generative ai consulting, ai implementation services, llm integration consultants, ai strategy for enterprises, enterprise ai transformation, ai prompt optimization, large language model consulting, ai training for teams, ai workflow automation, build ai knowledge base, llm prompt management, ai prompt infrastructure, ai adoption consulting, enterprise ai onboarding, custom ai workflow design, ai integration for dev teams, ai productivity tools, team prompt collaboration, github gists, github snippets, github code snippets, github code snippets automation, github, text expansion, text automation, snippet manager, code snippets, team collaboration tools, shared snippets, snippet sharing, keyboard shortcuts, productivity tools, workflow automation, AI-powered productivity, snippet tool for teams, team knowledge base, AI text completion, text expander for teams, snippet collaboration, multi-platform productivity, custom keyboard shortcuts, snippet sharing platform, collaborative snippet management, knowledge base automation, team productivity software, business productivity tools, snippet management software, quick text input, macOS productivity apps, Windows productivity tools, Linux productivity tools, cloud-based snippets, cross-platform snippets, team workspace tools, workflow enhancement tools, automation tools for teams, text automation software, team knowledge sharing, task automation, integrated team tools, real-time collaboration, AI for team productivity, business text automation, time-saving tools, clipboard manager, multi-device clipboard, keyboard shortcut manager, team communication tools, project management integration, productivity boost AI, text snippet sharing, text replacement software, text management tools, efficient team collaboration, AI workspace tools, modern productivity apps, custom text automation, digital workspace tools, collaborative workspaces, cloud productivity tools, streamline team workflows, smart text management, snippets AI app, snippet management for teams, shared knowledge platforms, team-focused text automation, team productivity platform, AI text expansion tools, snippet taking app, note taking app, note taking software, note taking tools, note taking app for teams, note taking app for developers, note taking app for AI, note taking app for ChatGPT, snippet software, snippet tools, snippet app for teams, snippet app for developers, snippet app for AI, snippet app for ChatGPT, AI agent builder, AI agent snippets, AI agent prompts, prompt management, prompt engineering, ChatGPT snippets, ChatGPT prompts, AI prompt optimization, AI-powered prompts, prompt libraries for AI, prompt sharing for ChatGPT, GPT productivity tools, AI assistant snippets, ChatGPT integrations, custom AI prompts, AI agent workflows, machine learning snippets, automated AI prompts, AI workflow automation, collaborative AI prompts, personalized AI agents, text snippets for ChatGPT, AI prompt creation tools, AI code snippet manager, GPT-4 text automation, AI-powered writing assistants, AI tools for developers, AI agent integrations, developer prompt snippets, AI text generation workflows, AI-enhanced productivity, GPT prompt sharing tools, team collaboration for AI, openAI integrations, text automation for AI teams, AI-powered collaboration tools, GPT-4 team tools, AI-driven text expanders, AI-driven productivity solutions, AI agent for email writing, AI agent for text expansion, AI agent for text automation, AI agent for text snippets, AI agent for text replacement, AI agent for keyboard shortcuts, AI Agent Developer, Prompt engineering, Machine Learning Engineer, AI Engineer, Customer Support, Code snippets for developers, Recruiting, AI agent for automation, AI agent for AI automation, AI agent for ChatGPT automation, AI agent for email automation, electron app for snippets, desktop snippet manager, code snippet organization, AI prompt repository, intelligent text expansion, vibe coding, Claude cli ai prompts, prompt optimizer, buy prompts, sell prompts, snippets store, sell scripts, buy scripts, buy python scripts, scraping scripts, AI prompt marketplace, ChatGPT prompt marketplace, best AI prompts, best ChatGPT prompts, AI prompt database, AI prompt packs, AI prompt bundles, GPT prompt marketplace, prompt engineering masterclass, prompt engineering certification, prompt engineering course, ChatGPT prompt store, AI prompt store, prompt monetization, sell AI prompts, buy AI prompts, prompt marketplace platform, AI prompt plugins, Claude prompt marketplace, AI prompt subscription, Custom GPT, real-time prompt collaboration, developer workflow optimization, team prompt library, knowledge management for developers, code snippet search, searchable code library, reusable code blocks, prompt engineering tools, prompt template management, collaborative coding, cross-team knowledge sharing, code snippet versioning, AI prompt templates, technical documentation tools, developer productivity suite, team snippet repository, AI prompt history, snippet synchronization, cloud snippet backup, markdown snippet support, syntax highlighting for snippets, code categorization, programming language snippets, language-specific code templates, contextual code suggestions, snippets with AI integration, command palette for snippets, code snippet folder organization, team snippet discovery, private and public snippets, enterprise code management, team codebase documentation, prompt engineering best practices, Vibe Coding, Vibe Coding for developers, Vibe Coding for AI, Vibe Coding for ChatGPT, Vibe Coding for email, Vibe Coding for text, Vibe Coding for keyboard shortcuts, Vibe Coding for text expansion, Vibe Coding for text snippets, Vibe Coding for text replacement, free prompt generator, ai prompt generator, prompt generator, promptlayer, promptimize ai, langchain prompt management, lanhsmith prompt management, latitude, langchain, langgraph, langchain documentation, raycast, text expander, raycast snippets, raycast mac, cursor, cursro ai, cursor snippets, cursor rules, cursor ai rules, learn prompting, how to prompt, prompting guide, prompting tutorials, best prompting practices, ai prompt best practices, prompting techniques, prompting, aws, testing, api, go, express, pwa, javascript, react, typescript, java, nextjs, jest, ios, spa, performance, accessibility, security, node, seo, rest, python, webpack, vite, windows, logging, php, laravel, redis, monitoring, openai, gpt, azure, gcp, rust, swift, deployment, vue, angular, django, ci/cd, ssr, nuxt, c#, jwt, lambda, microservices, git, pandas, flask, analytics, cdn, oauth, mongodb, graphql, react native, electron, spring, android, scaling, mocha, machine learning, numpy

AI Prompts, ChatGPT, Code Snippets, Prompt Engineering

qodo
https://qodo.ai

JAX Best Practices