Heat oil in a wok on high. Stir-fry lamb in batches for 1-2 minutes until browned. Transfer to a plate.
Reheat wok and stir-fry garlic, lemongrass, ginger and chilli for 1 minute until fragrant. Return lamb to wok with lime rind and juice and fish sauce and toss to coat. Remove from heat and stir through herbs.