Bump PyTorch to 2.1

[JingyaHuang]

What does this PR do?

Fixes #486

• Inference (non-llm)
• Inference (llm)
• TGI
• Training, partial, remaining will be done in Sync transformers and accelerate versions #562

Before submitting

• This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
• Did you make sure to update the documentation with your changes?
• Did you write any new necessary tests?

[JingyaHuang]

[Non-LLM INF Tests]

tests/cli/test_export_cli.py ...........                                                                                               [  2%]
tests/exporters/test_export.py ........................................................................................... [ 16%]
.......................................................................................................................... [ 33%]
............................................................                                                                                                               [ 42%]
tests/inference/test_modeling.py F........................................................................................ [ 65%]
.......................................................................................................................... [ 83%]
..............................                                                                                                                                             [ 87%]
tests/inference/test_stable_diffusion_pipeline.py ..........                                                                                                               [ 88%]

1 test failed since weight neff separation is not supported for torch_neuronx for PyTorch 2.1.2 in Neuron SDK 2.17.

* Log

FAILED tests/inference/test_modeling.py::NeuronModelIntegrationTest::test_decouple_weights_neff_and_replace_weight - AttributeError: 'RecursiveScriptModule' object has no attribute 'weights'

replace_weights is not yet supported by neuron SDK 2.17 for PyTorch 2.*, will skip the test for now.

[HuggingFaceDocBuilderDev]

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

[HuggingFaceDocBuilderDev]

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread. Thank you!

[dacorvo]

Let's merge this.