In a small bowl, mix olive oil, salt and pepper. Place chicken in a zip top bag with lemons, thyme, and olive oil mixture. Seal bag and refrigerate for 2 to 3 hours.
Heat grill to medium high heat. Place chicken on grill and cook until internal temperature is 165 degrees. Remove chicken from grill and tent with foil.