GPT-3.5 Turbo and GPT-4 Turbo are available through the OpenRouter API, so switching between them takes a model slug change rather than a new integration.
GPT-3.5 Turbo, from OpenAI, has a 16,385-token context window and is priced at $0.50/M tokens input, $1.50/M tokens output on OpenRouter.
GPT-4 Turbo, from OpenAI, has a 128,000-token context window and is priced at $10/M tokens input, $30/M tokens output on OpenRouter.