With this little test I hope you'll understand why the pull-up (and pull-down) resistors are needed in digital circuits like in Arduino.
With a pull-up resistor and with the button unpressed you make a logic state ON and with the button pressed you make a logic OFF.
With a pull - down resistor and a pressed button you make an ON logic state and OFF logic state when its unpressed.