adapt actions to git.nadeko.net

dockerfile: use x86-64-v2 instead to support more CPUs
I used x86-64-v3 because my CPU supports it, but I doubt this is going to make Invidious any faster of most of the operations.
2024-12-09 16:57:28 -03:00 · 2024-11-26 19:31:48 -03:00 · 2024-11-16 12:27:10 -03:00 · 2024-11-16 12:10:51 -03:00 · 2024-11-16 12:07:05 -03:00 · 2024-11-13 21:14:26 -03:00
34 changed files with 536 additions and 391 deletions
--- a/.forgejo/workflows/ci.yml
+++ b/.forgejo/workflows/ci.yml
@ -14,9 +14,23 @@ on:
 jobs:
  build:
    runs-on: runner
-    
+
    steps:
-    - uses: https://code.forgejo.org/actions/checkout@v2
+    - uses: https://code.forgejo.org/actions/checkout@v4
+
+    - name: Set up cache
+      uses: https://code.forgejo.org/actions/cache@v3
+      id: ccache-restore
+      with:
+        path: |
+          ./lib
+        key: ${{ runner.os }}-invidious-${{ github.sha }}
+        restore-keys: |
+          ${{ runner.os }}-invidious-
+
+    - name: Create cache directory
+      if: steps.ccache-restore.outputs.cache-hit != 'true'
+      run: mkdir -p ./lib

    - uses: https://code.forgejo.org/docker/setup-buildx-action@v3
      name: Setup Docker BuildX system
@ -32,12 +46,12 @@ jobs:
      id: meta
      uses: https://github.com/docker/metadata-action@v5
      with:
-        images: git.nadeko.net/fijxu/invidious
+        images: git.nadeko.net/fijxu/invidious-with-companion
        tags: |
          type=sha,format=short,prefix={{date 'YYYY.MM.DD'}}-,enable=${{ github.ref == format('refs/heads/{0}', 'master') }}
          type=raw,value=latest,enable=${{ github.ref == format('refs/heads/{0}', 'master') }}

-    - uses: https://code.forgejo.org/docker/build-push-action@v5
+    - uses: https://code.forgejo.org/docker/build-push-action@v6
      name: Build images
      with:
        context: .
@ -47,4 +61,3 @@ jobs:
        push: true
        build-args: |
          "release=1"
-
--- a/.github/workflows/ci.yml
+++ b/.github/workflows/ci.yml
@ -54,7 +54,7 @@ jobs:

      - name: Install required APT packages
        run: |
-          sudo apt install -y libsqlite3-dev 
+          sudo apt install -y libsqlite3-dev
        shell: bash

      - name: Install Crystal
@ -65,7 +65,9 @@ jobs:
      - name: Cache Shards
        uses: actions/cache@v3
        with:
-          path: ./lib
+          path: |
+            ./lib
+            ./bin
          key: shards-${{ hashFiles('shard.lock') }}

      - name: Install Shards
@ -77,14 +79,6 @@ jobs:
      - name: Run tests
        run: crystal spec

-      - name: Run lint
-        run: |
-          if ! crystal tool format --check; then
-            crystal tool format
-            git diff
-            exit 1
-          fi
-
      - name: Build
        run: crystal build --warnings all --error-on-warnings --error-trace src/invidious.cr

@ -130,8 +124,12 @@ jobs:
      - name: Test Docker
        run: while curl -Isf http://localhost:3000; do sleep 1; done

-  ameba_lint:
+  lint:
+
    runs-on: ubuntu-latest
+
+    continue-on-error: true
+
    steps:
      - uses: actions/checkout@v4
        with:
@ -151,7 +149,18 @@ jobs:
          key: shards-${{ hashFiles('shard.lock') }}

      - name: Install Shards
-        run: shards install
+        run: |
+          if ! shards check; then
+            shards install
+          fi
+
+      - name: Check Crystal formatter compliance
+        run: |
+          if ! crystal tool format --check; then
+            crystal tool format
+            git diff
+            exit 1
+          fi

      - name: Run Ameba linter
        run: bin/ameba
--- a/.github/workflows/stale.yml
+++ b/.github/workflows/stale.yml
@ -13,14 +13,11 @@ jobs:
    - uses: actions/stale@v8
      with:
        repo-token: ${{ secrets.GITHUB_TOKEN }}
-        days-before-stale: 365
-        days-before-pr-stale: 90 
-        days-before-close: 30
-        exempt-pr-labels: blocked,exempt-stale
+        days-before-stale: 730
+        days-before-pr-stale: -1 
+        days-before-close: 60
        stale-issue-message: 'This issue has been automatically marked as stale and will be closed in 30 days because it has not had recent activity and is much likely outdated. If you think this issue is still relevant and applicable, you just have to post a comment and it will be unmarked.'
-        stale-pr-message: 'This pull request has been automatically marked as stale and will be closed in 30 days because it has not had recent activity and is much likely abandoned or outdated. If you think this pull request is still relevant and applicable, you just have to post a comment and it will be unmarked.'
        stale-issue-label: "stale"
-        stale-pr-label: "stale"
        ascending: true
-        # Never mark feature requests/enhancements as stale
-        exempt-issue-labels: "feature-request,enhancement,exempt-stale"
+        # Exempt the following types of issues from being staled
+        exempt-issue-labels: "feature-request,enhancement,discussion,exempt-stale"
--- a/CHANGELOG.md
+++ b/CHANGELOG.md
@ -3,8 +3,92 @@
 ## vX.Y.0 (future)


+## v2.20241110.0
+
+### Wrap-up
+
+This release is most importantly here to fix to the annoying "Youtube API returned error 400"
+error that prevented all channel pages from loading.
+
+If you're updating from the previous release, it provides no improvements on the ability to play
+videos. If updating from a commit in-between release, it removes the "Please sign in" error caused
+by a previous attempt at restoring video playback on large instances.
+
+In the preferences, a new option allows for control of video preload. When enabled, this option
+tells the browser to load the video as soon as the page is loaded (this used to be the default).
+When disabled, the video starts loading only when the "play" button is pressed.
+
+New interface languages available: Bulgarian, Welsh and Lombard
+
+New dependency required: `tzdata`.
+
+An HTTP proxy can be configured directly in Invidious, if needed. \
+**NOTE:** In that case, it is recommended to comment out `force_resolve`.
+
+
+### New features & important changes
+
+#### For users
+
+* Channels: Fix "Youtube API returned error 400" error preventing channel pages from loading
+* Channels: Shorts can now be sorted by "newest", "oldest" and "popular"
+* Preferences: Addition of the new "preload" option
+* New interface languages available: Bulgarian, Welsh and Lombard
+* Added "Filipino (auto-generated)" to the list of caption languages available
+* Lots of new translations from Weblate
+
+#### For instance owners
+
+* Allow the configuration of an HTTP proxy to talk to Youtube
+* Invidious tries to reconnect to `inv_sig_helper` if the socket is closed
+* The instance list is downloaded in the background to improve redirection speed
+* New `colorize_logs` option makes each log level a different color
+
+#### For developpers
+
+* `/api/v1/channels/{id}/shorts` now supports the `sort-by` parameter with the following values:
+  `newest`, `oldest` and `popular`
+* Older `/api/v1/channels/xyz/{id}` (tab name before UCID) were removed
+* API/Search: New video metadata available: `isNew`, `is4k`, `is8k`, `isVr180`, `isVr360`,
+  `is3d` and `hasCaptions`
+
+### Bugs fixed
+
+#### User-side
+
+* Channels: The second page of shorts now loads as expected
+* Channels: Fixed intermittent empty "playlists" tab
+* Search: Fixed `youtu.be` URLs not being properly redirected to the watch page
+* Fixed `DB::MappingException` error on the subscriptions feed (due to missing `tzdata` in docker)
+* Switching to another instance is much faster
+* Fixed an "invalid byte sequence" error when subscribing to a playlist
+* Videos: Playback URLs were sometimes broken when cached and `inv_sig_helper` was used
+
+#### For instance owners
+
+* Fix `force_resolve` being ignored in some cases
+
+#### API
+
+* API/Videos: Fixed `live_now` and `premiere_timestamp` sometimes not having the right values
+
+
 ### Full list of pull requests merged since the last release (newest first)

+* API: Add "sort_by" parameter to channels/shorts endpoint ([#5071], thanks @iBicha)
+* Docker: Install tzdata in Dockerfile ([#5070], by @SamantazFox)
+* Videos: Stop using TVHTML5_SIMPLY_EMBEDDED_PLAYER ([#5063], thanks @unixfox)
+* Routing: Deprecate old channel API routes ([#5045], by @SamantazFox)
+* Videos: use WEB client instead of WEB CREATOR ([#4984], thanks @unixfox)
+* Parsers: Fix parsing live_now and premiere_timestamp ([#4934], thanks @absidue)
+* Stale bot updates ([#5060], thanks @syeopite)
+* Channels: Fix "Youtube API returned error 400" ([#5059], by @SamantazFox)
+* Channels: Fix for live videos ([#5027], thanks @iBicha)
+* Locales: Add Bulgarian, Welsh and Lombard to the list ([#5046], by @SamantazFox)
+* Shards: Update database dependencies ([#5034], by @SamantazFox)
+* Logger: Add color support for different log levels ([#4931], thanks @Fijxu)
+* Fix named arg syntax when passing force_resolve ([#4754], thanks @syeopite)
+* Use make_client instead of calling HTTP::Client ([#4709], thanks @syeopite)
 * Add "Filipino (auto-generated)" to the list of caption languages ([#4995], by @SamantazFox)
 * Makefile: Add MT option to enable the 'preview_mt' flag ([#4993], by @SamantazFox)
 * SigHelper: Reconnect to signature helper ([#4991], thanks @Fijxu)
@ -31,7 +115,9 @@
 [#4270]: https://github.com/iv-org/invidious/pull/4270
 [#4326]: https://github.com/iv-org/invidious/pull/4326
 [#4652]: https://github.com/iv-org/invidious/pull/4652
+[#4709]: https://github.com/iv-org/invidious/pull/4709
 [#4750]: https://github.com/iv-org/invidious/pull/4750
+[#4754]: https://github.com/iv-org/invidious/pull/4754
 [#4850]: https://github.com/iv-org/invidious/pull/4850
 [#4862]: https://github.com/iv-org/invidious/pull/4862
 [#4863]: https://github.com/iv-org/invidious/pull/4863
@ -41,10 +127,22 @@
 [#4923]: https://github.com/iv-org/invidious/pull/4923
 [#4928]: https://github.com/iv-org/invidious/pull/4928
 [#4930]: https://github.com/iv-org/invidious/pull/4930
+[#4931]: https://github.com/iv-org/invidious/pull/4931
+[#4934]: https://github.com/iv-org/invidious/pull/4934
 [#4942]: https://github.com/iv-org/invidious/pull/4942
+[#4984]: https://github.com/iv-org/invidious/pull/4984
 [#4991]: https://github.com/iv-org/invidious/pull/4991
 [#4993]: https://github.com/iv-org/invidious/pull/4993
 [#4995]: https://github.com/iv-org/invidious/pull/4995
+[#5027]: https://github.com/iv-org/invidious/pull/5027
+[#5034]: https://github.com/iv-org/invidious/pull/5034
+[#5045]: https://github.com/iv-org/invidious/pull/5045
+[#5046]: https://github.com/iv-org/invidious/pull/5046
+[#5059]: https://github.com/iv-org/invidious/pull/5059
+[#5060]: https://github.com/iv-org/invidious/pull/5060
+[#5063]: https://github.com/iv-org/invidious/pull/5063
+[#5070]: https://github.com/iv-org/invidious/pull/5070
+[#5071]: https://github.com/iv-org/invidious/pull/5071


 ## v2.20240825.2 (2024-08-26)
--- a/config/config.example.yml
+++ b/config/config.example.yml
@ -235,11 +235,13 @@ http_proxy:

 ##
 ## Enables colors in logs. Useful for debugging purposes
-## This is overridden if "-k" or "--colorize" 
+## This is overridden if "-k" or "--colorize"
 ## are passed on the command line.
+## Colors are also disabled if the environment variable
+## NO_COLOR is present and has any value
 ##
 ## Accepted values: true, false
-## Default: false
+## Default: true
 ##
 #colorize_logs: false

--- a/docker/Dockerfile
+++ b/docker/Dockerfile
@ -1,4 +1,4 @@
-FROM crystallang/crystal:1.12.1-alpine AS builder
+FROM crystallang/crystal:1.14.0-alpine AS builder

 RUN apk add --no-cache sqlite-static yaml-static

@ -23,7 +23,7 @@ RUN crystal spec --warnings all \
    --link-flags "-lxml2 -llzma"
 RUN if [[ "${release}" == 1 ]] ; then \
        crystal build ./src/invidious.cr \
-        --release --mcpu=x86-64-v3 \
+        --release --mcpu=x86-64-v2 \
        --static --warnings all \
        --link-flags "-lxml2 -llzma"; \
    else \
@ -32,8 +32,8 @@ RUN if [[ "${release}" == 1 ]] ; then \
        --link-flags "-lxml2 -llzma"; \
    fi

-FROM alpine:3.18
-RUN apk add --no-cache rsvg-convert ttf-opensans tini
+FROM alpine:3.20
+RUN apk add --no-cache rsvg-convert ttf-opensans tini tzdata
 WORKDIR /invidious
 RUN addgroup -g 1000 -S invidious && \
    adduser -u 1000 -S invidious -G invidious
--- a/docker/Dockerfile.arm64
+++ b/docker/Dockerfile.arm64
@ -1,5 +1,6 @@
-FROM alpine:3.19 AS builder
-RUN apk add --no-cache 'crystal=1.10.1-r0' shards sqlite-static yaml-static yaml-dev libxml2-static zlib-static openssl-libs-static openssl-dev musl-dev xz-static
+FROM alpine:3.20 AS builder
+RUN apk add --no-cache 'crystal=1.12.2-r0' shards sqlite-static yaml-static yaml-dev libxml2-static \
+       zlib-static openssl-libs-static openssl-dev musl-dev xz-static

 ARG release

@ -32,8 +33,8 @@ RUN if [[ "${release}" == 1 ]] ; then \
        --link-flags "-lxml2 -llzma"; \
    fi

-FROM alpine:3.18
-RUN apk add --no-cache rsvg-convert ttf-opensans tini
+FROM alpine:3.20
+RUN apk add --no-cache rsvg-convert ttf-opensans tini tzdata
 WORKDIR /invidious
 RUN addgroup -g 1000 -S invidious && \
    adduser -u 1000 -S invidious -G invidious
--- a/shard.lock
+++ b/shard.lock
@ -14,7 +14,7 @@ shards:

  db:
    git: https://github.com/crystal-lang/crystal-db.git
-    version: 0.10.1
+    version: 0.13.1

  exception_page:
    git: https://github.com/crystal-loot/exception_page.git
@ -37,7 +37,7 @@ shards:

  pg:
    git: https://github.com/will/crystal-pg.git
-    version: 0.24.0
+    version: 0.28.0

  pool:
    git: https://github.com/ysbaddaden/pool.git
@ -61,5 +61,5 @@ shards:

  sqlite3:
    git: https://github.com/crystal-lang/crystal-sqlite3.git
-    version: 0.18.0
+    version: 0.21.0

--- a/shard.yml
+++ b/shard.yml
@ -1,21 +1,20 @@
 name: invidious
-version: 0.20.1
+version: 2.20241110.0-dev

 authors:
-  - Omar Roth <omarroth@protonmail.com>
-  - Invidious team
+  - Invidious team <contact@invidious.io>
+  - Contributors!

-targets:
-  invidious:
-    main: src/invidious.cr
+description: |
+   Invidious is an alternative front-end to YouTube 

 dependencies:
  pg:
    github: will/crystal-pg
-    version: ~> 0.24.0
+    version: ~> 0.28.0
  sqlite3:
    github: crystal-lang/crystal-sqlite3
-    version: ~> 0.18.0
+    version: ~> 0.21.0
  kemal:
    github: kemalcr/kemal
    version: ~> 1.1.2
@ -45,6 +44,10 @@ development_dependencies:
    github: crystal-ameba/ameba
    version: ~> 1.6.1

-crystal: ">= 1.0.0, < 2.0.0"
+crystal: ">= 1.10.0, < 2.0.0"

 license: AGPLv3
+
+repository: https://github.com/iv-org/invidious
+homepage: https://invidious.io
+documentation: https://docs.invidious.io
--- a/src/invidious/channels/videos.cr
+++ b/src/invidious/channels/videos.cr
@ -1,78 +1,3 @@
-def produce_channel_content_continuation(ucid, content_type, page = 1, auto_generated = nil, sort_by = "newest", v2 = false)
-  object_inner_2 = {
-    "2:0:embedded" => {
-      "1:0:varint" => 0_i64,
-    },
-    "5:varint"  => 50_i64,
-    "6:varint"  => 1_i64,
-    "7:varint"  => (page * 30).to_i64,
-    "9:varint"  => 1_i64,
-    "10:varint" => 0_i64,
-  }
-
-  object_inner_2_encoded = object_inner_2
-    .try { |i| Protodec::Any.cast_json(i) }
-    .try { |i| Protodec::Any.from_json(i) }
-    .try { |i| Base64.urlsafe_encode(i) }
-    .try { |i| URI.encode_www_form(i) }
-
-  content_type_numerical =
-    case content_type
-    when "videos"      then 15
-    when "livestreams" then 14
-    else                    15 # Fallback to "videos"
-    end
-
-  sort_by_numerical =
-    case sort_by
-    when "newest"  then 1_i64
-    when "popular" then 2_i64
-    when "oldest"  then 4_i64
-    else                1_i64 # Fallback to "newest"
-    end
-
-  object_inner_1 = {
-    "110:embedded" => {
-      "3:embedded" => {
-        "#{content_type_numerical}:embedded" => {
-          "1:embedded" => {
-            "1:string" => object_inner_2_encoded,
-          },
-          "2:embedded" => {
-            "1:string" => "00000000-0000-0000-0000-000000000000",
-          },
-          "3:varint" => sort_by_numerical,
-        },
-      },
-    },
-  }
-
-  object_inner_1_encoded = object_inner_1
-    .try { |i| Protodec::Any.cast_json(i) }
-    .try { |i| Protodec::Any.from_json(i) }
-    .try { |i| Base64.urlsafe_encode(i) }
-    .try { |i| URI.encode_www_form(i) }
-
-  object = {
-    "80226972:embedded" => {
-      "2:string"  => ucid,
-      "3:string"  => object_inner_1_encoded,
-      "35:string" => "browse-feed#{ucid}videos102",
-    },
-  }
-
-  continuation = object.try { |i| Protodec::Any.cast_json(i) }
-    .try { |i| Protodec::Any.from_json(i) }
-    .try { |i| Base64.urlsafe_encode(i) }
-    .try { |i| URI.encode_www_form(i) }
-
-  return continuation
-end
-
-def make_initial_content_ctoken(ucid, content_type, sort_by) : String
-  return produce_channel_content_continuation(ucid, content_type, sort_by: sort_by)
-end
-
 module Invidious::Channel::Tabs
  extend self

@ -101,7 +26,7 @@ module Invidious::Channel::Tabs
  end

  def get_videos(author : String, ucid : String, *, continuation : String? = nil, sort_by = "newest")
-    continuation ||= make_initial_content_ctoken(ucid, "videos", sort_by)
+    continuation ||= make_initial_videos_ctoken(ucid, sort_by)
    initial_data = YoutubeAPI.browse(continuation: continuation)

    return extract_items(initial_data, author, ucid)
@ -130,14 +55,10 @@ module Invidious::Channel::Tabs
  #  Shorts
  # -------------------

-  def get_shorts(channel : AboutChannel, continuation : String? = nil)
-    if continuation.nil?
-      # EgZzaG9ydHPyBgUKA5oBAA%3D%3D is the protobuf object to load "shorts"
-      # TODO: try to extract the continuation tokens that allows other sorting options
-      initial_data = YoutubeAPI.browse(channel.ucid, params: "EgZzaG9ydHPyBgUKA5oBAA%3D%3D")
-    else
-      initial_data = YoutubeAPI.browse(continuation: continuation)
-    end
+  def get_shorts(channel : AboutChannel, *, continuation : String? = nil, sort_by = "newest")
+    continuation ||= make_initial_shorts_ctoken(channel.ucid, sort_by)
+    initial_data = YoutubeAPI.browse(continuation: continuation)
+
    return extract_items(initial_data, channel.author, channel.ucid)
  end

@ -145,9 +66,8 @@ module Invidious::Channel::Tabs
  #  Livestreams
  # -------------------

-  def get_livestreams(channel : AboutChannel, continuation : String? = nil, sort_by = "newest")
-    continuation ||= make_initial_content_ctoken(channel.ucid, "livestreams", sort_by)
-
+  def get_livestreams(channel : AboutChannel, *, continuation : String? = nil, sort_by = "newest")
+    continuation ||= make_initial_livestreams_ctoken(channel.ucid, sort_by)
    initial_data = YoutubeAPI.browse(continuation: continuation)

    return extract_items(initial_data, channel.author, channel.ucid)
@ -171,4 +91,102 @@ module Invidious::Channel::Tabs

    return items, next_continuation
  end
+
+  # -------------------
+  #  C-tokens
+  # -------------------
+
+  private def sort_options_videos_short(sort_by : String)
+    case sort_by
+    when "newest"  then return 4_i64
+    when "popular" then return 2_i64
+    when "oldest"  then return 5_i64
+    else                return 4_i64 # Fallback to "newest"
+    end
+  end
+
+  # Generate the initial "continuation token" to get the first page of the
+  # "videos" tab. The following page requires the ctoken provided in that
+  # first page, and so on.
+  private def make_initial_videos_ctoken(ucid : String, sort_by = "newest")
+    object = {
+      "15:embedded" => {
+        "2:embedded" => {
+          "1:string" => "00000000-0000-0000-0000-000000000000",
+        },
+        "4:varint" => sort_options_videos_short(sort_by),
+      },
+    }
+
+    return channel_ctoken_wrap(ucid, object)
+  end
+
+  # Generate the initial "continuation token" to get the first page of the
+  # "shorts" tab. The following page requires the ctoken provided in that
+  # first page, and so on.
+  private def make_initial_shorts_ctoken(ucid : String, sort_by = "newest")
+    object = {
+      "10:embedded" => {
+        "2:embedded" => {
+          "1:string" => "00000000-0000-0000-0000-000000000000",
+        },
+        "4:varint" => sort_options_videos_short(sort_by),
+      },
+    }
+
+    return channel_ctoken_wrap(ucid, object)
+  end
+
+  # Generate the initial "continuation token" to get the first page of the
+  # "livestreams" tab. The following page requires the ctoken provided in that
+  # first page, and so on.
+  private def make_initial_livestreams_ctoken(ucid : String, sort_by = "newest")
+    sort_by_numerical =
+      case sort_by
+      when "newest"  then 12_i64
+      when "popular" then 14_i64
+      when "oldest"  then 13_i64
+      else                12_i64 # Fallback to "newest"
+      end
+
+    object = {
+      "14:embedded" => {
+        "2:embedded" => {
+          "1:string" => "00000000-0000-0000-0000-000000000000",
+        },
+        "5:varint" => sort_by_numerical,
+      },
+    }
+
+    return channel_ctoken_wrap(ucid, object)
+  end
+
+  # The protobuf structure common between videos/shorts/livestreams
+  private def channel_ctoken_wrap(ucid : String, object)
+    object_inner = {
+      "110:embedded" => {
+        "3:embedded" => object,
+      },
+    }
+
+    object_inner_encoded = object_inner
+      .try { |i| Protodec::Any.cast_json(i) }
+      .try { |i| Protodec::Any.from_json(i) }
+      .try { |i| Base64.urlsafe_encode(i) }
+      .try { |i| URI.encode_www_form(i) }
+
+    object = {
+      "80226972:embedded" => {
+        "2:string" => ucid,
+        "3:string" => object_inner_encoded,
+      },
+    }
+
+    continuation = object.try { |i| Protodec::Any.cast_json(i) }
+      .try { |i| Protodec::Any.from_json(i) }
+      .try { |i| Base64.urlsafe_encode(i) }
+      .try { |i| URI.encode_www_form(i) }
+
+    return continuation
+  end
 end
--- a/src/invidious/config.cr
+++ b/src/invidious/config.cr
@ -45,8 +45,6 @@ struct ConfigPreferences
  property vr_mode : Bool = true
  property show_nick : Bool = true
  property save_player_pos : Bool = false
-  property po_token : String = ""
-  property visitor_data : String = ""

  def to_tuple
    {% begin %}
@ -204,6 +202,8 @@ class Config

  property ignore_user_tokens : Bool = false

+  property server_id_cookie_name : String = "INVIDIOUS_SERVER_ID"
+
  {% if flag?(:linux) %}
    property reload_config_automatically : Bool = true
  {% end %}
--- a/src/invidious/helpers/i18n.cr
+++ b/src/invidious/helpers/i18n.cr
@ -1,8 +1,22 @@
+# Languages requiring a better level of translation (at least 20%)
+# to be added to the list below:
+#
+#  "af"      => "", # Afrikaans
+#  "az"      => "", # Azerbaijani
+#  "be"      => "", # Belarusian
+#  "bn_BD"   => "", # Bengali (Bangladesh)
+#  "ia"      => "", # Interlingua
+#  "or"      => "", # Odia
+#  "tk"      => "", # Turkmen
+#  "tok      => "", # Toki Pona
+#
 LOCALES_LIST = {
  "ar"      => "العربية",               # Arabic
+  "bg"      => "български",             # Bulgarian
  "bn"      => "বাংলা",                 # Bengali
  "ca"      => "Català",                # Catalan
  "cs"      => "Čeština",               # Czech
+  "cy"      => "Cymraeg",               # Welsh
  "da"      => "Dansk",                 # Danish
  "de"      => "Deutsch",               # German
  "el"      => "Ελληνικά",              # Greek
@ -23,6 +37,7 @@ LOCALES_LIST = {
  "it"      => "Italiano",              # Italian
  "ja"      => "日本語",                   # Japanese
  "ko"      => "한국어",                   # Korean
+  "lmo"     => "Lombard",               # Lombard
  "lt"      => "Lietuvių",              # Lithuanian
  "nb-NO"   => "Norsk bokmål",          # Norwegian Bokmål
  "nl"      => "Nederlands",            # Dutch
--- a/src/invidious/helpers/logger.cr
+++ b/src/invidious/helpers/logger.cr
@ -12,7 +12,9 @@ enum LogLevel
 end

 class Invidious::LogHandler < Kemal::BaseLogHandler
-  def initialize(@io : IO = STDOUT, @level = LogLevel::Debug, @color : Bool = true)
+  def initialize(@io : IO = STDOUT, @level = LogLevel::Debug, use_color : Bool = true)
+    Colorize.enabled = use_color
+    Colorize.on_tty_only!
  end

  def call(context : HTTP::Server::Context)
@ -56,8 +58,7 @@ class Invidious::LogHandler < Kemal::BaseLogHandler
  {% for level in %w(trace debug info warn error fatal) %}
    def {{level.id}}(message : String)
      if LogLevel::{{level.id.capitalize}} >= @level
-        puts("#{Time.utc} [{{level.id}}] #{message}".colorize(color(LogLevel::{{level.id.capitalize}})).toggle(@color))
-
+        puts("#{Time.utc} [{{level.id}}] #{message}".colorize(color(LogLevel::{{level.id.capitalize}})))
      end
    end
  {% end %}
--- a/src/invidious/helpers/redis_tokens.cr
+++ b/src/invidious/helpers/redis_tokens.cr
@ -6,14 +6,20 @@ module Tokens
  def refresh_tokens
    @@po_token = REDIS_DB.get("invidious:po_token")
    @@visitor_data = REDIS_DB.get("invidious:visitor_data")
-	if !@@po_token.nil? && !@@visitor_data.nil?
-		LOGGER.debug("RefreshTokens: Successfully updated tokens")
-	else
-		LOGGER.warn("RefreshTokens: Tokens are empty!")
-	end
+    if !@@po_token.nil? && !@@visitor_data.nil?
+      set_tokens
+      LOGGER.debug("RefreshTokens: Successfully updated po_token and visitor_data")
+    else
+      LOGGER.warn("RefreshTokens: Tokens are empty!")
+    end
    LOGGER.trace("RefreshTokens: Tokens are:")
-    LOGGER.trace("RefreshTokens: po_token: #{@@po_token}")
-    LOGGER.trace("RefreshTokens: visitor_data: #{@@visitor_data}")
+    LOGGER.trace("RefreshTokens: po_token: #{CONFIG.po_token}")
+    LOGGER.trace("RefreshTokens: visitor_data: #{CONFIG.visitor_data}")
+  end
+
+  def set_tokens
+    CONFIG.po_token = @@po_token
+    CONFIG.visitor_data = @@visitor_data
  end

  def get_tokens
@ -27,28 +33,4 @@ module Tokens
  def get_visitor_data
    return @@visitor_data
  end
-
-  def generate_tokens(user : String)
-    po_token = ""
-    visitor_data = ""
-    attempts = 0
-
-    LOGGER.debug("Generating po_token and visitor_data for user: '#{user}'")
-    REDIS_DB.publish("generate-token", "#{user}")
-
-    while REDIS_DB.get("invidious:#{user}:po_token").nil? && REDIS_DB.get("invidious:#{user}:visitor_data").nil?
-      if attempts > 50
-        break
-      end
-      LOGGER.debug("Waiting for tokens to arrive at redis for user: '#{user}'")
-      attempts += 1
-      sleep 250.milliseconds
-    end
-
-    po_token = REDIS_DB.get("invidious:#{user}:po_token")
-    visitor_data = REDIS_DB.get("invidious:#{user}:visitor_data")
-
-    LOGGER.debug("Tokens successfully generated for user: '#{user}'")
-    return {po_token, visitor_data}
-  end
 end
--- a/src/invidious/routes/account.cr
+++ b/src/invidious/routes/account.cr
@ -349,40 +349,4 @@ module Invidious::Routes::Account
      return "{}"
    end
  end
-
-  # -------------------
-  #  poToken and visitorData tokens generation
-  # -------------------
-
-  # Generates a poToken & visitorData for the user, server side
-  def generate_tokens(env)
-    locale = env.get("preferences").as(Preferences).locale
-    preferences = env.get("preferences").as(Preferences)
-
-    user = env.get? "user"
-    sid = env.get? "sid"
-    referer = get_referer(env)
-
-    if !user
-      return env.redirect referer
-    end
-
-    user = user.as(User)
-
-    po_token, visitor_data = Tokens.generate_tokens(user.email)
-
-    if po_token.nil? || visitor_data.nil?
-      return error_template(500, "Internal server error. Please submit an issue here IF THE ISSUE PERSISTS: https://git.nadeko.net/Fijxu/invidious/issues")
-    end
-
-    user.preferences.po_token = po_token
-    user.preferences.visitor_data = visitor_data
-
-    Invidious::Database::Users.update_preferences(user)
-
-    REDIS_DB.del("invidious:#{user.email}:po_token")
-    REDIS_DB.del("invidious:#{user.email}:visitor_data")
-
-    templated "user/tokens"
-  end
 end
--- a/src/invidious/routes/api/v1/channels.cr
+++ b/src/invidious/routes/api/v1/channels.cr
@ -197,6 +197,7 @@ module Invidious::Routes::API::V1::Channels
    get_channel()

    # Retrieve continuation from URL parameters
+    sort_by = env.params.query["sort_by"]?.try &.downcase || "newest"
    continuation = env.params.query["continuation"]?

    if channel.is_age_gated
@ -211,7 +212,7 @@ module Invidious::Routes::API::V1::Channels
    else
      begin
        videos, next_continuation = Channel::Tabs.get_shorts(
-          channel, continuation: continuation
+          channel, continuation: continuation, sort_by: sort_by
        )
      rescue ex
        return error_json(500, ex)
--- a/src/invidious/routes/api/v1/search.cr
+++ b/src/invidious/routes/api/v1/search.cr
@ -31,9 +31,7 @@ module Invidious::Routes::API::V1::Search
    query = env.params.query["q"]? || ""

    begin
-      client = HTTP::Client.new("suggestqueries-clients6.youtube.com")
-      client.before_request { |r| add_yt_headers(r) }
-
+      client = make_client(URI.parse("https://suggestqueries-clients6.youtube.com"), force_youtube_headers: true)
      url = "/complete/search?client=youtube&hl=en&gl=#{region}&q=#{URI.encode_www_form(query)}&gs_ri=youtube&ds=yt"

      response = client.get(url).body
--- a/src/invidious/routes/channels.cr
+++ b/src/invidious/routes/channels.cr
@ -20,10 +20,11 @@ module Invidious::Routes::Channels
    sort_by = env.params.query["sort_by"]?.try &.downcase

    if channel.auto_generated
+      sort_by ||= "last"
      sort_options = {"last", "oldest", "newest"}

      items, next_continuation = fetch_channel_playlists(
-        channel.ucid, channel.author, continuation, (sort_by || "last")
+        channel.ucid, channel.author, continuation, sort_by
      )

      items.uniq! do |item|
@ -49,9 +50,11 @@ module Invidious::Routes::Channels
        end
        next_continuation = nil
      else
+        sort_by ||= "newest"
        sort_options = {"newest", "oldest", "popular"}
-        items, next_continuation = Channel::Tabs.get_videos(
-          channel, continuation: continuation, sort_by: (sort_by || "newest")
+
+        items, next_continuation = Channel::Tabs.get_60_videos(
+          channel, continuation: continuation, sort_by: sort_by
        )
      end
    end
@ -82,13 +85,12 @@ module Invidious::Routes::Channels
      end
      next_continuation = nil
    else
-      # TODO: support sort option for shorts
-      sort_by = ""
-      sort_options = [] of String
+      sort_by = env.params.query["sort_by"]?.try &.downcase || "newest"
+      sort_options = {"newest", "oldest", "popular"}

      # Fetch items and continuation token
      items, next_continuation = Channel::Tabs.get_shorts(
-        channel, continuation: continuation
+        channel, continuation: continuation, sort_by: sort_by
      )
    end

--- a/src/invidious/routes/preferences.cr
+++ b/src/invidious/routes/preferences.cr
@ -86,12 +86,6 @@ module Invidious::Routes::PreferencesRoute
    show_nick ||= "off"
    show_nick = show_nick == "on"

-    po_token = env.params.body["po_token"]?.try &.as(String)
-    po_token ||= CONFIG.default_user_preferences.po_token
-
-    visitor_data = env.params.body["visitor_data"]?.try &.as(String)
-    visitor_data ||= CONFIG.default_user_preferences.visitor_data
-
    comments = [] of String
    2.times do |i|
      comments << (env.params.body["comments[#{i}]"]?.try &.as(String) || CONFIG.default_user_preferences.comments[i])
@ -186,8 +180,6 @@ module Invidious::Routes::PreferencesRoute
      vr_mode:                     vr_mode,
      show_nick:                   show_nick,
      save_player_pos:             save_player_pos,
-      po_token:                    po_token,
-      visitor_data:                visitor_data,
    }.to_json)

    if user = env.get? "user"
--- a/src/invidious/routes/switch_backend.cr
+++ b/src/invidious/routes/switch_backend.cr
@ -1,18 +0,0 @@
-{% skip_file if flag?(:api_only) %}
-
-module Invidious::Routes::BackendSwitcher
-  def self.switch(env)
-    referer = get_referer(env)
-    backend_id = env.params.query["backend_id"]
-
-    # Checks if there is any alternative domain, like a second domain name,
-    # TOR or I2P address
-    if alt = CONFIG.alternative_domains.index(env.request.headers["Host"])
-      env.response.cookies["SERVER_ID"] = Invidious::User::Cookies.server_id(CONFIG.alternative_domains[alt], backend_id)
-    else
-      env.response.cookies["SERVER_ID"] = Invidious::User::Cookies.server_id(CONFIG.domain, backend_id)
-    end
-
-    env.redirect referer
-  end
-end
--- a/src/invidious/routes/video_playback.cr
+++ b/src/invidious/routes/video_playback.cr
@ -47,11 +47,7 @@ module Invidious::Routes::VideoPlayback
      headers["Range"] = "bytes=#{range_for_head}"
    end

-    headers["Origin"] = "https://www.youtube.com"
-    headers["Referer"] = "https://www.youtube.com/"
-    headers["User-Agent"] = "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/129.0.0.0 Safari/537.36"
-
-    client = make_client(URI.parse(host), region, force_resolve = true)
+    client = make_client(URI.parse(host), region, force_resolve: true)
    response = HTTP::Client::Response.new(500)
    error = ""
    5.times do
@ -66,7 +62,7 @@ module Invidious::Routes::VideoPlayback
          if new_host != host
            host = new_host
            client.close
-            client = make_client(URI.parse(new_host), region, force_resolve = true)
+            client = make_client(URI.parse(new_host), region, force_resolve: true)
          end

          url = "#{location.request_target}&host=#{location.host}#{region ? "&region=#{region}" : ""}"
@ -80,7 +76,7 @@ module Invidious::Routes::VideoPlayback
        fvip = "3"

        host = "https://r#{fvip}---#{mn}.googlevideo.com"
-        client = make_client(URI.parse(host), region, force_resolve = true)
+        client = make_client(URI.parse(host), region, force_resolve: true)
      rescue ex
        error = ex.message
      end
@ -205,7 +201,7 @@ module Invidious::Routes::VideoPlayback
            break
          else
            client.close
-            client = make_client(URI.parse(host), region, force_resolve = true)
+            client = make_client(URI.parse(host), region, force_resolve: true)
          end
        end

--- a/src/invidious/routes/watch.cr
+++ b/src/invidious/routes/watch.cr
@ -3,14 +3,6 @@
 module Invidious::Routes::Watch
  def self.handle(env)
    locale = env.get("preferences").as(Preferences).locale
-    if !CONFIG.ignore_user_tokens
-      user_po_token = env.get("preferences").as(Preferences).po_token
-      user_visitor_data = env.get("preferences").as(Preferences).visitor_data
-    else
-      user_po_token = ""
-      user_visitor_data = ""
-    end
-
    region = env.params.query["region"]?

    if env.params.query.to_s.includes?("%20") || env.params.query.to_s.includes?("+")
@ -60,7 +52,7 @@ module Invidious::Routes::Watch
    env.params.query.delete_all("listen")

    begin
-      video = get_video(id, region: params.region, po_token: user_po_token, visitor_data: user_visitor_data)
+      video = get_video(id, region: params.region)
    rescue ex : NotFoundException
      LOGGER.error("get_video not found: #{id} : #{ex.message}")
      return error_template(404, ex)
@ -152,6 +144,7 @@ module Invidious::Routes::Watch
      end
    end

+    # Removes non default audio tracks
    audio_streams.reject! do |z|
      z if z.dig?("audioTrack", "audioIsDefault") == false
    end
@ -218,6 +211,12 @@ module Invidious::Routes::Watch
      captions: video.captions
    )

+    begin
+      video_url = fmt_stream[0]["url"].to_s
+    rescue
+      video_url = nil
+    end
+
    templated "watch"
  end

--- a/src/invidious/routing.cr
+++ b/src/invidious/routing.cr
@ -21,7 +21,6 @@ module Invidious::Routing
      get "/privacy", Routes::Misc, :privacy
      get "/licenses", Routes::Misc, :licenses
      get "/redirect", Routes::Misc, :cross_instance_redirect
-      get "/switchbackend", Routes::BackendSwitcher, :switch

      self.register_channel_routes
      self.register_watch_routes
@ -77,7 +76,6 @@ module Invidious::Routing
    post "/authorize_token", Routes::Account, :post_authorize_token
    get "/token_manager", Routes::Account, :token_manager
    post "/token_ajax", Routes::Account, :token_ajax
-    get "/generate_tokens", Routes::Account, :generate_tokens
    post "/subscription_ajax", Routes::Subscriptions, :toggle_subscription
    get "/subscription_manager", Routes::Subscriptions, :subscription_manager
  end
@ -245,17 +243,16 @@ module Invidious::Routing

      # Channels
      get "/api/v1/channels/:ucid", {{namespace}}::Channels, :home
+      get "/api/v1/channels/:ucid/latest", {{namespace}}::Channels, :latest
+      get "/api/v1/channels/:ucid/videos", {{namespace}}::Channels, :videos
      get "/api/v1/channels/:ucid/shorts", {{namespace}}::Channels, :shorts
      get "/api/v1/channels/:ucid/streams", {{namespace}}::Channels, :streams
      get "/api/v1/channels/:ucid/podcasts", {{namespace}}::Channels, :podcasts
      get "/api/v1/channels/:ucid/releases", {{namespace}}::Channels, :releases
-
+      get "/api/v1/channels/:ucid/playlists", {{namespace}}::Channels, :playlists
+      get "/api/v1/channels/:ucid/community", {{namespace}}::Channels, :community
      get "/api/v1/channels/:ucid/channels", {{namespace}}::Channels, :channels
-
-      {% for route in {"videos", "latest", "playlists", "community", "search"} %}
-        get "/api/v1/channels/#{{{route}}}/:ucid", {{namespace}}::Channels, :{{route}}
-        get "/api/v1/channels/:ucid/#{{{route}}}", {{namespace}}::Channels, :{{route}}
-      {% end %}
+      get "/api/v1/channels/:ucid/search", {{namespace}}::Channels, :search

      # Posts
      get "/api/v1/post/:id", {{namespace}}::Channels, :post
@ -273,11 +270,6 @@ module Invidious::Routing

      # Authenticated

-      # The notification APIs cannot be extracted yet! They require the *local* notifications constant defined in invidious.cr
-      #
-      # Invidious::Routing.get "/api/v1/auth/notifications", {{namespace}}::Authenticated, :notifications
-      # Invidious::Routing.post "/api/v1/auth/notifications", {{namespace}}::Authenticated, :notifications
-
      get "/api/v1/auth/preferences", {{namespace}}::Authenticated, :get_preferences
      post "/api/v1/auth/preferences", {{namespace}}::Authenticated, :set_preferences

--- a/src/invidious/user/cookies.cr
+++ b/src/invidious/user/cookies.cr
@ -45,18 +45,5 @@ struct Invidious::User
        samesite: HTTP::Cookie::SameSite::Lax
      )
    end
-
-    # Server ID (SERVER_ID) cookie used for Sticky Sessions
-    # Parameter "domain" comes from the global config
-    def server_id(domain : String?, server_id) : HTTP::Cookie
-      return HTTP::Cookie.new(
-        name: "SERVER_ID",
-        domain: domain,
-        value: server_id,
-        secure: false,
-        http_only: true,
-        samesite: HTTP::Cookie::SameSite::Lax
-      )
-    end
  end
 end
--- a/src/invidious/user/preferences.cr
+++ b/src/invidious/user/preferences.cr
@ -57,10 +57,6 @@ struct Preferences
  property volume : Int32 = CONFIG.default_user_preferences.volume
  property save_player_pos : Bool = CONFIG.default_user_preferences.save_player_pos

-  @[YAML::Field(converter: Preferences::ProcessString)]
-  property po_token : String = ""
-  property visitor_data : String = ""
-
  module BoolToString
    def self.to_json(value : String, json : JSON::Builder)
      json.string value
--- a/src/invidious/videos.cr
+++ b/src/invidious/videos.cr
@ -294,7 +294,7 @@ struct Video
  predicate_bool upcoming, isUpcoming
 end

-def get_video(id, refresh = true, region = nil, force_refresh = false, po_token = "", visitor_data = "")
+def get_video(id, refresh = true, region = nil, force_refresh = false)
  if (video = Invidious::Database::Videos.select(id)) && !region
    # If record was last updated over 10 minutes ago, or video has since premiered,
    # refresh (expire param in response lasts for 6 hours)
@ -304,7 +304,7 @@ def get_video(id, refresh = true, region = nil, force_refresh = false, po_token
       force_refresh ||
       video.schema_version != Video::SCHEMA_VERSION # cache control
      begin
-        video = fetch_video(id, region, po_token, visitor_data)
+        video = fetch_video(id, region)
        Invidious::Database::Videos.insert(video)
      rescue ex
        Invidious::Database::Videos.delete(id)
@ -312,7 +312,7 @@ def get_video(id, refresh = true, region = nil, force_refresh = false, po_token
      end
    end
  else
-    video = fetch_video(id, region, po_token, visitor_data)
+    video = fetch_video(id, region)
    Invidious::Database::Videos.insert(video) if !region
  end

@ -320,11 +320,11 @@ def get_video(id, refresh = true, region = nil, force_refresh = false, po_token
 rescue DB::Error
  # Avoid common `DB::PoolRetryAttemptsExceeded` error and friends
  # Note: All DB errors inherit from `DB::Error`
-  return fetch_video(id, region, po_token, visitor_data)
+  return fetch_video(id, region)
 end

-def fetch_video(id, region, po_token, visitor_data)
-  info = extract_video_info(video_id: id, user_po_token: po_token, user_visitor_data: visitor_data)
+def fetch_video(id, region)
+  info = extract_video_info(video_id: id)

  if reason = info["reason"]?
    if reason == "Video unavailable"
--- a/src/invidious/videos/parser.cr
+++ b/src/invidious/videos/parser.cr
@ -50,17 +50,17 @@ def parse_related_video(related : JSON::Any) : Hash(String, JSON::Any)?
  }
 end

-def extract_video_info(video_id : String, user_po_token, user_visitor_data)
+def extract_video_info(video_id : String)
  # Init client config for the API
  client_config = YoutubeAPI::ClientConfig.new

  redis_po_token, redis_visitor_data = Tokens.get_tokens

-  po_token = (user_po_token if !user_po_token.empty?) || redis_po_token || CONFIG.po_token
-  visitor_data = (user_visitor_data if !user_visitor_data.empty?) || redis_visitor_data || CONFIG.visitor_data
+  po_token = redis_po_token || CONFIG.po_token
+  visitor_data = redis_visitor_data || CONFIG.visitor_data

  # Fetch data from the player endpoint
-  player_response = YoutubeAPI.player(video_id: video_id, params: "2AMB", client_config: client_config, po_token: po_token, visitor_data: visitor_data)
+  player_response = YoutubeAPI.player(video_id: video_id, params: "2AMB", client_config: client_config)

  playability_status = player_response.dig?("playabilityStatus", "status").try &.as_s

@ -107,24 +107,15 @@ def extract_video_info(video_id : String, user_po_token, user_visitor_data)

  new_player_response = nil

-  # Don't use Android client if po_token is passed because po_token doesn't
-  # work for Android client.
+  # Don't use Android test suite client if po_token is passed because po_token doesn't
+  # work for Android test suite client.
  if reason.nil? && po_token.nil?
    # Fetch the video streams using an Android client in order to get the
    # decrypted URLs and maybe fix throttling issues (#2194). See the
    # following issue for an explanation about decrypted URLs:
    # https://github.com/TeamNewPipe/NewPipeExtractor/issues/562
    client_config.client_type = YoutubeAPI::ClientType::AndroidTestSuite
-    new_player_response = try_fetch_streaming_data(video_id, client_config, po_token, visitor_data)
-  end
-
-  # Last hope
-  # Only trigger if reason found and po_token or didn't work wth Android client.
-  # TvHtml5ScreenEmbed now requires sig helper for it to work but po_token is not required
-  # if the IP address is not blocked.
-  if po_token.nil? && reason || po_token.nil? && new_player_response.nil?
-    client_config.client_type = YoutubeAPI::ClientType::TvHtml5ScreenEmbed
-    new_player_response = try_fetch_streaming_data(video_id, client_config, po_token, visitor_data)
+    new_player_response = try_fetch_streaming_data(video_id, client_config)
  end

  # Replace player response and reset reason
@ -145,7 +136,7 @@ def extract_video_info(video_id : String, user_po_token, user_visitor_data)
  if streaming_data = player_response["streamingData"]?
    %w[formats adaptiveFormats].each do |key|
      streaming_data.as_h[key]?.try &.as_a.each do |format|
-        format.as_h["url"] = JSON::Any.new(convert_url(format, po_token))
+        format.as_h["url"] = JSON::Any.new(convert_url(format))
      end
    end

@ -158,9 +149,9 @@ def extract_video_info(video_id : String, user_po_token, user_visitor_data)
  return params
 end

-def try_fetch_streaming_data(id : String, client_config : YoutubeAPI::ClientConfig, po_token, visitor_data) : Hash(String, JSON::Any)?
+def try_fetch_streaming_data(id : String, client_config : YoutubeAPI::ClientConfig) : Hash(String, JSON::Any)?
  LOGGER.debug("try_fetch_streaming_data: [#{id}] Using #{client_config.client_type} client.")
-  response = YoutubeAPI.player(video_id: id, params: "2AMB", client_config: client_config, po_token: po_token, visitor_data: visitor_data)
+  response = YoutubeAPI.player(video_id: id, params: "2AMB", client_config: client_config)

  playability_status = response["playabilityStatus"]["status"]
  LOGGER.debug("try_fetch_streaming_data: [#{id}] Got playabilityStatus == #{playability_status}.")
@ -229,8 +220,17 @@ def parse_video_info(video_id : String, player_response : Hash(String, JSON::Any
  premiere_timestamp = microformat.dig?("liveBroadcastDetails", "startTimestamp")
    .try { |t| Time.parse_rfc3339(t.as_s) }

+  premiere_timestamp ||= player_response.dig?(
+    "playabilityStatus", "liveStreamability",
+    "liveStreamabilityRenderer", "offlineSlate",
+    "liveStreamOfflineSlateRenderer", "scheduledStartTime"
+  )
+    .try &.as_s.to_i64
+      .try { |t| Time.unix(t) }
+
  live_now = microformat.dig?("liveBroadcastDetails", "isLiveNow")
-    .try &.as_bool || false
+    .try &.as_bool
+  live_now ||= video_details.dig?("isLive").try &.as_bool || false

  post_live_dvr = video_details.dig?("isPostLiveDvr")
    .try &.as_bool || false
@ -460,7 +460,7 @@ def parse_video_info(video_id : String, player_response : Hash(String, JSON::Any
  return params
 end

-private def convert_url(fmt, po_token)
+private def convert_url(fmt)
  if cfr = fmt["signatureCipher"]?.try { |json| HTTP::Params.parse(json.as_s) }
    sp = cfr["sp"]
    url = URI.parse(cfr["url"])
@ -478,9 +478,7 @@ private def convert_url(fmt, po_token)
  n = DECRYPT_FUNCTION.try &.decrypt_nsig(params["n"])
  params["n"] = n if n

-  if !po_token.nil?
-    params["pot"] = po_token
-  elsif token = CONFIG.po_token
+  if token = CONFIG.po_token
    params["pot"] = token
  end

--- a/src/invidious/views/template.ecr
+++ b/src/invidious/views/template.ecr
@ -1,7 +1,7 @@
 <%
 	locale = env.get("preferences").as(Preferences).locale
 	dark_mode = env.get("preferences").as(Preferences).dark_mode
-	current_backend = env.request.cookies["SERVER_ID"]?.try &.value
+	current_backend = env.request.cookies[CONFIG.server_id_cookie_name]?.try &.value
 %>
 <!DOCTYPE html>
 <html lang="<%= locale %>">
@ -310,7 +310,7 @@
            </div>
            <hr/>
            <div class="footer-footer">
-			<div class="box">You are currently using Backend: <%= current_backend %></p>
+			<div class="box">You are currently using Backend: <%= current_backend %></div>
                <span class="left">
                    <% if CONFIG.modified_source_code_url %>
                        <%= translate(locale, "footer_current_version_modified") %>
--- a/src/invidious/views/user/preferences.ecr
+++ b/src/invidious/views/user/preferences.ecr
@ -126,24 +126,6 @@
                <input name="save_player_pos" id="save_player_pos" type="checkbox" <% if preferences.save_player_pos %>checked<% end %>>
            </div>

-            <% if !CONFIG.ignore_user_tokens %>
-			<div class="pure-control-group">
-                <label for="po_token"><%= translate(locale, "preferences_po_token") %></label>
-                <input name="po_token" id="po_token" type="text" value="<%= preferences.po_token %>">
-            </div>
-
-			<div class="pure-control-group">
-                <label for="visitor_data"><%= translate(locale, "preferences_visitor_data") %></label>
-                <input name="visitor_data" id="visitor_data" type="text" value="<%= preferences.visitor_data %>">
-            </div>
-
-        <% if env.get?("user") %>
-			<div class="pure-control-group">
-				<a href="/generate_tokens?referer=<%= URI.encode_www_form(referer) %>"><%= translate(locale, "Generate po_token and visitor_data for your account") %></a>
-			</div>
-        <% end %>
-        <% end %>
-
            <legend><%= translate(locale, "preferences_category_visual") %></legend>

            <div class="pure-control-group">
--- a/src/invidious/views/user/tokens.ecr
+++ b/src/invidious/views/user/tokens.ecr
@ -1,15 +0,0 @@
-<% content_for "header" do %>
-<title><%= translate(locale, "Invidious token generator") %> - Invidious</title>
-<% end %>
-
-<div class="pure-g">
-    <div class="pure-u-1 pure-u-lg-1-5"></div>
-    <div class="pure-u-1 pure-u-lg-3-5">
-        <div class="h-box">
-		<p>po_token and visitor_data successfully generated!</p>
-		<p>po_token: <%= po_token %></p>
-		<p>visitor_data: <%= visitor_data %></p>
-        </div>
-    </div>
-    <div class="pure-u-1 pure-u-lg-1-5"></div>
-</div>
--- a/src/invidious/views/watch.ecr
+++ b/src/invidious/views/watch.ecr
@ -13,11 +13,13 @@
 <meta property="og:image" content="<%= HOST_URL %>/vi/<%= video.id %>/maxres.jpg">
 <meta property="og:description" content="<%= HTML.escape(video.short_description) %>">
 <meta property="og:type" content="video.other">
-<meta property="og:video:url" content="<%= HOST_URL %>/embed/<%= video.id %>">
-<meta property="og:video:secure_url" content="<%= HOST_URL %>/embed/<%= video.id %>">
-<meta property="og:video:type" content="text/html">
-<meta property="og:video:width" content="1280">
-<meta property="og:video:height" content="720">
+<!-- This shouldn't be empty, ever. -->
+<meta property="og:video" content="<%= video_url %>"> 
+<meta property="og:video:url" content="<%= video_url %>">
+<meta property="og:video:secure_url" content="<%= video_url %>">
+<meta property="og:video:type" content="video/mp4">
+<meta property="og:video:width" content="640">
+<meta property="og:video:height" content="360">
 <meta name="twitter:card" content="player">
 <meta name="twitter:url" content="<%= HOST_URL %>/watch?v=<%= video.id %>">
 <meta name="twitter:title" content="<%= title %>">
--- a/src/invidious/yt_backend/connection_pool.cr
+++ b/src/invidious/yt_backend/connection_pool.cr
@ -22,12 +22,8 @@ struct YoutubeConnectionPool
      response = yield conn
    rescue ex
      conn.close
+      conn = make_client(url, force_resolve: true)

-      conn = HTTP::Client.new(url)
-      conn.proxy = make_configured_http_proxy_client() if CONFIG.http_proxy
-      conn.family = CONFIG.force_resolve
-      conn.family = Socket::Family::INET if conn.family == Socket::Family::UNSPEC
-      conn.before_request { |r| add_yt_headers(r) } if url.host == "www.youtube.com"
      response = yield conn
    ensure
      pool.release(conn)
@ -37,12 +33,15 @@ struct YoutubeConnectionPool
  end

  private def build_pool
-    DB::Pool(HTTP::Client).new(initial_pool_size: 0, max_pool_size: capacity, max_idle_pool_size: capacity, checkout_timeout: timeout) do
-      conn = HTTP::Client.new(url)
-      conn.family = CONFIG.force_resolve
-      conn.family = Socket::Family::INET if conn.family == Socket::Family::UNSPEC
-      conn.before_request { |r| add_yt_headers(r) } if url.host == "www.youtube.com"
-      conn
+    options = DB::Pool::Options.new(
+      initial_pool_size: 0,
+      max_pool_size: capacity,
+      max_idle_pool_size: capacity,
+      checkout_timeout: timeout
+    )
+
+    DB::Pool(HTTP::Client).new(options) do
+      next make_client(url, force_resolve: true)
    end
  end
 end
@ -62,15 +61,17 @@ def add_yt_headers(request)
  end
 end

-def make_client(url : URI, region = nil, force_resolve : Bool = false)
+def make_client(url : URI, region = nil, force_resolve : Bool = false, force_youtube_headers : Bool = false)
  client = HTTP::Client.new(url)
+  client.proxy = make_configured_http_proxy_client() if CONFIG.http_proxy

  # Force the usage of a specific configured IP Family
  if force_resolve
    client.family = CONFIG.force_resolve
+    client.family = Socket::Family::INET if client.family == Socket::Family::UNSPEC
  end

-  client.before_request { |r| add_yt_headers(r) } if url.host == "www.youtube.com"
+  client.before_request { |r| add_yt_headers(r) } if url.host.try &.ends_with?("youtube.com") || force_youtube_headers
  client.read_timeout = 10.seconds
  client.connect_timeout = 10.seconds

@ -78,7 +79,7 @@ def make_client(url : URI, region = nil, force_resolve : Bool = false)
 end

 def make_client(url : URI, region = nil, force_resolve : Bool = false, &)
-  client = make_client(url, region, force_resolve)
+  client = make_client(url, region, force_resolve: force_resolve)
  begin
    yield client
  ensure
--- a/src/invidious/yt_backend/extractors.cr
+++ b/src/invidious/yt_backend/extractors.cr
@ -21,6 +21,7 @@ private ITEM_PARSERS = {
  Parsers::ItemSectionRendererParser,
  Parsers::ContinuationItemRendererParser,
  Parsers::HashtagRendererParser,
+  Parsers::LockupViewModelParser,
 }

 private alias InitialData = Hash(String, JSON::Any)
@ -467,9 +468,9 @@ private module Parsers
  # Parses an InnerTube richItemRenderer into a SearchVideo.
  # Returns nil when the given object isn't a RichItemRenderer
  #
-  # A richItemRenderer seems to be a simple wrapper for a videoRenderer, used
-  # by the result page for hashtags and for the podcast tab on channels.
-  # It is located inside a continuationItems container for hashtags.
+  # A richItemRenderer seems to be a simple wrapper for a various other types,
+  # used on the hashtags result page and the channel podcast tab. It is located
+  # itself inside a richGridRenderer container.
  #
  module RichItemRendererParser
    def self.process(item : JSON::Any, author_fallback : AuthorFallback)
@ -482,6 +483,8 @@ private module Parsers
      child = VideoRendererParser.process(item_contents, author_fallback)
      child ||= ReelItemRendererParser.process(item_contents, author_fallback)
      child ||= PlaylistRendererParser.process(item_contents, author_fallback)
+      child ||= LockupViewModelParser.process(item_contents, author_fallback)
+      child ||= ShortsLockupViewModelParser.process(item_contents, author_fallback)
      return child
    end

@ -496,6 +499,9 @@ private module Parsers
  # reelItemRenderer items are used in the new (2022) channel layout,
  # in the "shorts" tab.
  #
+  # NOTE: As of 10/2024, it might have been fully replaced by shortsLockupViewModel
+  # TODO: Confirm that hypothesis
+  #
  module ReelItemRendererParser
    def self.process(item : JSON::Any, author_fallback : AuthorFallback)
      if item_contents = item["reelItemRenderer"]?
@ -582,6 +588,135 @@ private module Parsers
    end
  end

+  # Parses an InnerTube lockupViewModel into a SearchPlaylist.
+  # Returns nil when the given object is not a lockupViewModel.
+  #
+  # This structure is present since November 2024 on the "podcasts" and
+  # "playlists" tabs of the channel page. It is usually encapsulated in either
+  # a richItemRenderer or a richGridRenderer.
+  #
+  module LockupViewModelParser
+    def self.process(item : JSON::Any, author_fallback : AuthorFallback)
+      if item_contents = item["lockupViewModel"]?
+        return self.parse(item_contents, author_fallback)
+      end
+    end
+
+    private def self.parse(item_contents, author_fallback)
+      playlist_id = item_contents["contentId"].as_s
+
+      thumbnail_view_model = item_contents.dig(
+        "contentImage", "collectionThumbnailViewModel",
+        "primaryThumbnail", "thumbnailViewModel"
+      )
+
+      thumbnail = thumbnail_view_model.dig("image", "sources", 0, "url").as_s
+
+      # This complicated sequences tries to extract the following data structure:
+      # "overlays": [{
+      #   "thumbnailOverlayBadgeViewModel": {
+      #     "thumbnailBadges": [{
+      #       "thumbnailBadgeViewModel": {
+      #         "text": "430 episodes",
+      #         "badgeStyle": "THUMBNAIL_OVERLAY_BADGE_STYLE_DEFAULT"
+      #       }
+      #     }]
+      #   }
+      # }]
+      #
+      # NOTE: this simplistic `.to_i` conversion might not work on larger
+      # playlists and hasn't been tested.
+      video_count = thumbnail_view_model.dig("overlays").as_a
+        .compact_map(&.dig?("thumbnailOverlayBadgeViewModel", "thumbnailBadges").try &.as_a)
+        .flatten
+        .find(nil, &.dig?("thumbnailBadgeViewModel", "text").try { |node|
+          {"episodes", "videos"}.any? { |str| node.as_s.ends_with?(str) }
+        })
+        .try &.dig("thumbnailBadgeViewModel", "text").as_s.to_i(strict: false)
+
+      metadata = item_contents.dig("metadata", "lockupMetadataViewModel")
+      title = metadata.dig("title", "content").as_s
+
+      # TODO: Retrieve "updated" info from metadata parts
+      # rows = metadata.dig("metadata", "contentMetadataViewModel", "metadataRows").as_a
+      # parts_text = rows.map(&.dig?("metadataParts", "text", "content").try &.as_s)
+      # One of these parts should contain a string like: "Updated 2 days ago"
+
+      # TODO: Maybe add a button to access the first video of the playlist?
+      # item_contents.dig("rendererContext", "commandContext", "onTap", "innertubeCommand", "watchEndpoint")
+      # Available fields: "videoId", "playlistId", "params"
+
+      return SearchPlaylist.new({
+        title:           title,
+        id:              playlist_id,
+        author:          author_fallback.name,
+        ucid:            author_fallback.id,
+        video_count:     video_count || -1,
+        videos:          [] of SearchPlaylistVideo,
+        thumbnail:       thumbnail,
+        author_verified: false,
+      })
+    end
+
+    def self.parser_name
+      return {{@type.name}}
+    end
+  end
+
+  # Parses an InnerTube shortsLockupViewModel into a SearchVideo.
+  # Returns nil when the given object is not a shortsLockupViewModel.
+  #
+  # This structure is present since around October 2024 on the "shorts" tab of
+  # the channel page and likely replaces the reelItemRenderer structure. It is
+  # usually (always?) encapsulated in a richItemRenderer.
+  #
+  module ShortsLockupViewModelParser
+    def self.process(item : JSON::Any, author_fallback : AuthorFallback)
+      if item_contents = item["shortsLockupViewModel"]?
+        return self.parse(item_contents, author_fallback)
+      end
+    end
+
+    private def self.parse(item_contents, author_fallback)
+      # TODO: Maybe add support for "oardefault.jpg" thumbnails?
+      # thumbnail = item_contents.dig("thumbnail", "sources", 0, "url").as_s
+      # Gives: https://i.ytimg.com/vi/{video_id}/oardefault.jpg?...
+
+      video_id = item_contents.dig(
+        "onTap", "innertubeCommand", "reelWatchEndpoint", "videoId"
+      ).as_s
+
+      title = item_contents.dig("overlayMetadata", "primaryText", "content").as_s
+
+      view_count = short_text_to_number(
+        item_contents.dig("overlayMetadata", "secondaryText", "content").as_s
+      )
+
+      # Approximate to one minute, as "shorts" generally don't exceed that.
+      # NOTE: The actual duration is not provided by Youtube anymore.
+      # TODO: Maybe use -1 as an error value and handle that on the frontend?
+      duration = 60_i32
+
+      SearchVideo.new({
+        title:              title,
+        id:                 video_id,
+        author:             author_fallback.name,
+        ucid:               author_fallback.id,
+        published:          Time.unix(0),
+        views:              view_count,
+        description_html:   "",
+        length_seconds:     duration,
+        premiere_timestamp: Time.unix(0),
+        author_verified:    false,
+        badges:             VideoBadges::None,
+      })
+    end
+
+    def self.parser_name
+      return {{@type.name}}
+    end
+  end
+
  # Parses an InnerTube continuationItemRenderer into a Continuation.
  # Returns nil when the given object isn't a continuationItemRenderer.
  #
--- a/src/invidious/yt_backend/youtube_api.cr
+++ b/src/invidious/yt_backend/youtube_api.cr
@ -3,8 +3,6 @@
 #

 module YoutubeAPI
-  @@visitor_data : String = ""
-
  extend self

  # For Android versions, see https://en.wikipedia.org/wiki/Android_version_history
@ -322,9 +320,7 @@ module YoutubeAPI
      client_context["client"]["platform"] = platform
    end

-    if !@@visitor_data.empty?
-      client_context["client"]["visitorData"] = @@visitor_data
-    elsif CONFIG.visitor_data.is_a?(String)
+    if CONFIG.visitor_data.is_a?(String)
      client_context["client"]["visitorData"] = CONFIG.visitor_data.as(String)
    end

@ -460,12 +456,7 @@ module YoutubeAPI
    *, # Force the following parameters to be passed by name
    params : String,
    client_config : ClientConfig | Nil = nil,
-    po_token : String | Nil,
-    visitor_data : String | Nil,
  )
-    if visitor_data
-      @@visitor_data = visitor_data
-    end
    # Playback context, separate because it can be different between clients
    playback_ctx = {
      "html5Preference" => "HTML5_PREF_WANTS",
@ -491,7 +482,7 @@ module YoutubeAPI
        "contentPlaybackContext" => playback_ctx,
      },
      "serviceIntegrityDimensions" => {
-        "poToken" => po_token || CONFIG.po_token,
+        "poToken" => CONFIG.po_token,
      },
    }

@ -625,9 +616,7 @@ module YoutubeAPI
      headers["User-Agent"] = user_agent
    end

-    if !@@visitor_data.empty?
-      headers["X-Goog-Visitor-Id"] = @@visitor_data
-    elsif CONFIG.visitor_data.is_a?(String)
+    if CONFIG.visitor_data.is_a?(String)
      headers["X-Goog-Visitor-Id"] = CONFIG.visitor_data.as(String)
    end

@ -639,6 +628,11 @@ module YoutubeAPI
    # Send the POST request
    body = YT_POOL.client() do |client|
      client.post(url, headers: headers, body: data.to_json) do |response|
+        if response.status_code != 200
+          raise InfoException.new("Error: non 200 status code. Youtube API returned \
+            status code #{response.status_code}. See <a href=\"https://docs.invidious.io/youtube-errors-explained/\"> \
+            https://docs.invidious.io/youtube-errors-explained/</a> for troubleshooting.")
+        end
        self._decompress(response.body_io, response.headers["Content-Encoding"]?)
      end
    end
Author	SHA1	Message	Date
Fijxu	041d6cc9d3	adapt actions to git.nadeko.net Some checks failed Invidious CI / build (push) Has been cancelled Details	2024-12-09 16:57:28 -03:00
Fijxu	79859100a8	dockerfile: use x86-64-v2 instead to support more CPUs I used x86-64-v3 because my CPU supports it, but I doubt this is going to make Invidious any faster of most of the operations.	2024-11-26 19:31:48 -03:00
Fijxu	47ef5dfe4c	Overwirte CONFIG.po_token and CONFIG.visitor_data by the tokens stored on redis This approach is better to prevent conflicts with the upstream repository.	2024-11-16 12:27:10 -03:00
Fijxu	13e00e674b	Remove server side generated tokens (`448007e5ba`)	2024-11-16 12:10:51 -03:00
Fijxu	3615bbd893	Remove user supplied po_token and visitor_data	2024-11-16 12:07:05 -03:00
Fijxu	9b9efc6841	Merge remote-tracking branch 'upstream/master'	2024-11-13 21:14:26 -03:00
Samantaz Fox	9892604758	Prepare for next release	2024-11-10 21:40:32 +01:00
Samantaz Fox	5d2dd40bc3	Release v2.20241110.0	2024-11-10 21:35:03 +01:00
Samantaz Fox	699d53ad41	Update shard.yml metadata (#5066 ) Changes are mostly based off of the Crystal compiler's own shard.yml Remember to bump the version attribute when creating a release!!!	2024-11-10 21:03:13 +01:00
Samantaz Fox	2150264d84	Update CHANGELOG.md	2024-11-10 18:00:26 +01:00
Samantaz Fox	d42561d74a	API: Add "sort_by" parameter to channels/shorts endpoint (#5071 ) Small follow up to PR 5059 No related issue	2024-11-10 17:50:00 +01:00
Samantaz Fox	7092bb8855	Docker: Install tzdata in Dockerfile (#5070 ) Should close 5067	2024-11-10 17:48:18 +01:00
Samantaz Fox	d7c35e6e3d	Videos: Stop using TVHTML5_SIMPLY_EMBEDDED_PLAYER (#5063 ) The age restriction bypass does not work anymore with this client. See: https://github.com/iv-org/invidious/issues/2189#issuecomment-2437740627 Related to 2189	2024-11-10 17:45:58 +01:00
Samantaz Fox	bc86fb8a82	Routing: Deprecate old channel API routes (#5045 ) Deprecate the following routes: * /api/v1/channels/videos/:ucid * /api/v1/channels/latest/:ucid * /api/v1/channels/playlists/:ucid * /api/v1/channels/community/:ucid * /api/v1/channels/search/:ucid in favor of: * /api/v1/channels/:ucid/videos * /api/v1/channels/:ucid/latest * /api/v1/channels/:ucid/playlists * /api/v1/channels/:ucid/community * /api/v1/channels/:ucid/search No related issue	2024-11-10 17:44:45 +01:00
Samantaz Fox	ec82c2f539	Videos: use WEB client instead of WEB CREATOR (#4984 ) Use the WEB client when a potoken is configured, otherwise try with Android test suite if there is no potoken configured. This PR reverts some of the changes made in 4928 Related to 4734	2024-11-10 17:41:54 +01:00
Samantaz Fox	4b363e32fa	Parsers: Fix parsing live_now and premiere_timestamp (#4934 ) This pull request fixes the parsing for the 'live_now' and 'premiere_timestamp' variables so that they work without the 'microformat' data being present. Related to 4929	2024-11-10 17:36:49 +01:00
Fijxu	036ab6ef65	Docker: Install tzdata in Dockerfile	2024-11-10 00:02:33 -03:00
Fijxu	c27a703544	Merge remote-tracking branch 'upstream/master'	2024-11-09 23:42:52 -03:00
Fijxu	5a75ef7f94	Remove old code that is done on the Openresty side	2024-11-09 23:37:58 -03:00
Fijxu	91c9cd45a4	Update CI	2024-11-09 23:37:58 -03:00
Fijxu	b953dc1ce7	Videos: Add support for OpenGraph videos To support OpenGraph clients like Discord and other platforms able to pull the video from the OpenGraph metadata.	2024-11-09 23:37:58 -03:00
Brahim Hadriche	d2123b4682	Sort channel shorts API	2024-11-09 17:49:06 -05:00
Émilien (perso)	0f8f32bca8	remove explicit usage of WEB	2024-11-09 22:21:09 +01:00
Emilien	f3e93ca83d	revert back to www.youtube.com when client_config.screen embed	2024-11-09 22:21:09 +01:00
Emilien	82b1506ccc	remove usage of WebEmbeddedPlayer	2024-11-09 22:21:09 +01:00
Emilien	b9ad9bd723	use WEB when po_token + android test suite when no po_token	2024-11-09 22:21:09 +01:00
syeopite	8bf7e02978	Change authors section to reflect current state	2024-11-09 13:04:10 -08:00
Samantaz Fox	1a49e798c8	Docker: Install tzdata in Dockerfile	2024-11-09 21:52:06 +01:00
syeopite	9d54cf903e	Update shard.yml metadata	2024-11-08 15:54:37 -08:00
Samantaz Fox	b173d4acf2	Update CHANGELOG.md	2024-11-08 23:45:15 +01:00
Samantaz Fox	43d5efd9da	Stale bot updates (#5060 ) * Prevents PRs from being considered staled * Double the stale timer for issues * Prevent discussion issues from being staled No related issue	2024-11-08 23:42:45 +01:00
Samantaz Fox	1480e0089f	Channels: Fix "Youtube API returned error 400" (#5059 ) This PR also adds sort option to the channel "shorts" tab. Thanks to iBicha for the original fix of the "livestreams" tab. Closes 4029, 5021 and 5029	2024-11-08 23:40:34 +01:00
Samantaz Fox	a5fb78bba5	Locales: Add Bulgarian, Welsh and Lombard to the list (#5046 ) No related issue	2024-11-08 23:33:36 +01:00
Samantaz Fox	09f5485889	Shards: Update database dependencies (#5034 ) No related issue	2024-11-08 23:32:25 +01:00
Samantaz Fox	a760b69cb6	Logger: Add color support for different log levels (#4931 ) No related issue	2024-11-08 23:28:51 +01:00
Samantaz Fox	4f7a18a630	Fix named arg syntax when passing force_resolve (#4754 ) No related issue	2024-11-08 23:27:22 +01:00
Samantaz Fox	42da2547e3	Use make_client instead of calling HTTP::Client (#4709 ) No related issue	2024-11-08 23:26:32 +01:00
Émilien (perso)	09ccea1d31	remove usage of TVHTML5_SIMPLY_EMBEDDED_PLAYER	2024-11-08 22:01:23 +01:00
Samantaz Fox	2a19dbb1fe	Channels: Use the same structure as in the other ctoken functions Change explanation, courtesy of iBicha: The \n is basically a decimal 10, which is 1010 binary. That is a field number 1, and a wire type 2 (length-delimited). Then the $ is a decimal 36, which is exactly the length of 00000000-0000-0000-0000-000000000000. So both objects end up being encoded into the same data.	2024-11-08 18:28:58 +01:00
Samantaz Fox	6dd662a5b8	Channels: lockupViewModel is also used in the "playlists" tab	2024-11-08 17:44:36 +01:00
Samantaz Fox	301aeffa78	Channels: Multiple small fixes Fix the "newest" link not being bold when 'sort_by' uses the default value Show 60 videos per page, rather than 30	2024-11-08 14:00:35 +01:00
Samantaz Fox	d27a5e7fae	Channels: Rename ctoken generator functions as requested	2024-11-08 14:00:35 +01:00
Samantaz Fox	afc5b27d83	Extractors: Add support for shortsLockupViewModel The 'shortsLockupViewModel' structure is used in the channel "shorts" tab	2024-11-08 14:00:30 +01:00
Samantaz Fox	1a5047aad9	Extractors: Add support for lockupViewModel The 'lockupViewModel' structure is used in the channel "podcasts" tab	2024-11-08 14:00:16 +01:00
syeopite	ce910b5269	Prevent discussion issues from being staled	2024-11-07 20:45:23 -08:00
syeopite	78f18b257c	Double stale timer for issues Days before staling is increased to 730 days Days before closing is increased to 60 days	2024-11-07 20:42:19 -08:00
syeopite	3196182d4d	Prevent PRs from being considered stale	2024-11-07 20:41:04 -08:00
Samantaz Fox	82248fad02	Channels: Add sort options to shorts	2024-11-07 23:08:36 +01:00
Samantaz Fox	cbc546f032	Channels: Add function to generate the new ctoken objects	2024-11-07 23:08:31 +01:00
Samantaz Fox	792d0d5f6d	CI: Check Crystal lint only on latest version (#5042 ) * CI: Check Crystal lint only on latest version * Apply suggestion from code review Co-authored-by: syeopite <70992037+syeopite@users.noreply.github.com> --------- Co-authored-by: syeopite <70992037+syeopite@users.noreply.github.com>	2024-11-07 13:14:36 +00:00
Émilien (perso)	ac6e796c73	checking the status code returned by youtube (#5052 ) * checking the status code returned by youtube * add documentation link * Update src/invidious/yt_backend/youtube_api.cr Co-authored-by: syeopite <70992037+syeopite@users.noreply.github.com> --------- Co-authored-by: syeopite <70992037+syeopite@users.noreply.github.com>	2024-11-07 14:04:43 +01:00
Samantaz Fox	75c5881c55	Locales: Add Bulgarian, Welsh and Lombard to the list	2024-10-31 13:34:51 +01:00
Samantaz Fox	6da18ddc41	Routing: Also remove outdated comment about notification routes	2024-10-31 11:52:09 +01:00
Samantaz Fox	cdf93b29e6	Routing: Remove deprecated /api/v1/channels/.../:ucid routes	2024-10-31 11:51:33 +01:00
Brahim Hadriche	c243d08afb	refactor	2024-10-30 13:38:13 -04:00
Samantaz Fox	711d52d47f	Shards: Update database dependencies	2024-10-29 17:26:24 +01:00
Brahim Hadriche	ee72809282	[Alternative] Fix for channel live videos	2024-10-26 12:40:31 -04:00
Fijxu	d2edd4b63f	fixup! Logger: Add color support for different log levels	2024-10-08 18:36:50 -03:00
Fijxu	17b525f2a6	Logger: colorize_logs false by default	2024-09-27 18:08:21 -03:00
absidue	b2a83991d1	Fix parsing live_now and premiere_timestamp	2024-09-20 18:46:00 +02:00
Fijxu	d77afdcf00	Logger: Make colorize_logs true by default	2024-09-20 00:32:27 -03:00
Fijxu	f8ec312328	Logger: Add color support for different log levels	2024-09-19 21:35:52 -03:00
syeopite	6e39b9b303	make_client: add YouTube headers on *.youtube.com	2024-08-24 19:41:39 -07:00
syeopite	46c58bd84c	Pool: Use force_resolve in fallback new client	2024-08-24 19:41:23 -07:00
syeopite	7521902e88	Ensure IP family is always used when force_resolve	2024-08-24 19:41:22 -07:00
syeopite	bd48af825c	Search API: Fix named arg syntax to make_client	2024-08-24 19:34:09 -07:00
syeopite	ee89db49ba	Typo Co-authored-by: Samantaz Fox <coding@samantaz.fr>	2024-08-24 19:34:09 -07:00
syeopite	3af6681869	Fix typo in argument to `make_client` Co-authored-by: ChunkyProgrammer <78101139+ChunkyProgrammer@users.noreply.github.com>	2024-08-24 19:34:09 -07:00
syeopite	1124dd645d	Use `make_client` instead of calling `HTTP::Client` Using `make_client` to create `HTTP::Client`, allows for a simple way to easily add logic to all `HTTP::Client` initialized within Invidious.	2024-08-24 19:34:09 -07:00
syeopite	c24ed85110	Fix named arg syntax when passing force_resolve	2024-06-16 14:49:48 -07:00