Amend your neural network so that weights can be initialised randomly.
Keep a copy of your original program, so that you can compare performance.
Test both your versions, with fixed and with random weights, three times each and compare the results. What observations can you make?