In a small bowl, combine paprika, Italian seasoning, garlic powder, onion powder, pepper, and salt. Pat the chicken thighs dry with paper towels—this is crucial for crispy skin in the air fryer. Rub the olive oil all over each thigh, then generously coat with the spice mixture, making sure to season both sides and under the skin if possible. I like to let the seasoned chicken sit for a few minutes while the air fryer preheats so the flavors can start to penetrate the meat.