Tradeoff between dedicating resources to your best known option and dedicating them to discovering new options.
Simulated annealing (Wikipedia) is an approach to optimization problems that can be thought of as slowly transitioning from explore-heavy to exploit-heavy strategies, and it tends to work pretty well for finding global optima even in large, high-dimensional search spaces.
cf Resilience vs Efficiency, in psychology Cognition vs Closure