01Search space definition: Defining the set of prompt variables to optimize.
02Grid search: Testing all combinations of predefined parameter values.
03Random search: Sampling random parameter combinations efficiently.
04Evolutionary strategies: Using mutation and selection to evolve prompts.
05Bayesian optimization: Using probabilistic models to guide search.