I was looking for help on this but couldn't find it so I am contributing.
Yes you can remove buttons from the toolbar that you don't want.
How:
Set the ToolbarLayout layout to only the buttons you want. Use a pipe(|) char for item separator.
example:-
.ToolbarLayout = "Cut,Copy,Paste,Undo,Redo,Bold,Italic,Underline,RemoveFormat";