You may have noticed that there is an x icon after each row/column/element. Click it to remove the row/column/element it is in.

PS. When you remove a column, the elements inside it will also be removed. When you remove a row, both its internal columns and elements are removed.