Concerns raised about Gregg Wallace’s “inappropriate” behaviour on a BBC show were ignored, a former producer has claimed.