Deleting a graphics object is easier than inserting or creating it. Just click the object to select it and then press the Delete key. Excel removes the graphics object from the worksheet. You can delete grouped objects this way, too.
If you want to bring the object back, it's never too late. Just click the Undo button on the Standard toolbar. Excel displays the graphics object on your worksheet.