Jim do you get any sound at all when pressing the start button? Do you have a starter switch that you can activate by hand when connected across the starter solenoid? Before removing the starter you should do some electrical checks at the solenoid. Are you sure that the engine is free to turn over? If both the engine turns and the solenoid connects the power leads then you probably should remove the starter.
Bill