The Sussexes visited the UK with their two children earlier this month.
Buckingham Palace is being warned just weeks after Prince Harry and Meghan Markle met with the King.