Allegations of misconduct have been made in opposition to former London accomplice turned MP, Charlie Elphicke, by a former colleague of his.