.. _archive-changelog:

Archive ChangeLog
=================

Below you can find a time-indexed list of notable events and changes to
archival policies in the Software Heritage Archive. Each of them might have
(had) an impact on how content is archived and explain apparent statistical
anomalies or other changes in archival behavior over time. They are collected
in this document for historical reasons.

2023
----

* **2023-04-18** Completed first archival of `annas-software.org gitea
  forge <https://annas-software.org/>`_. Regular crawling of their
  repositories enabled (tracking: `#4855
  <https://gitlab.softwareheritage.org/swh/infra/sysadm-environment/-/issues/4855>`_)

* **2023-04-18** Completed first archival of `Internet Systems Consortium's gitlab
  forge <https://gitlab.isc.org/>`_. Regular crawling of their
  repositories enabled (tracking: `#4854
  <https://gitlab.softwareheritage.org/swh/infra/sysadm-environment/-/issues/4854>`_)

* **2023-04-13** Completed first archival of `dev.sanctum.geek.nz cgit forge
  <https://dev.sanctum.geek.nz/>`_. Regular crawling of their
  repositories enabled (tracking: `#4852
  <https://gitlab.softwareheritage.org/swh/infra/sysadm-environment/-/issues/4852>`_)

* **2023-04-13** Completed first archival of `trueelena.org cgit forge
  <https://git.trueelena.org/>`_. Regular crawling of their
  repositories enabled (tracking: `#4851
  <https://gitlab.softwareheritage.org/swh/infra/sysadm-environment/-/issues/4851>`_)

* **2023-04-12** Completed first archival of `Epita infra gitlab forge
  <https://gitlab.cri.epita.fr/cri>`_. Regular crawling of their
  repositories enabled (tracking: `#4845
  <https://gitlab.softwareheritage.org/swh/infra/sysadm-environment/-/issues/4845>`_)

* **2023-04-11** Completed first archival of `INRAE MathNum department gitlab forge
  <https://forgemia.inra.fr/>`_. Regular crawling of their
  repositories enabled (tracking: `#4842
  <https://gitlab.softwareheritage.org/swh/infra/sysadm-environment/-/issues/4842>`_)

* **2023-04-11** Completed first archival of `Montpellier Bioinformatics Biodiversity
  platform gitlab forge <https://gitlab.mbb.cnrs.fr/>`_. Regular crawling of their
  repositories enabled (tracking: `#4843
  <https://gitlab.softwareheritage.org/swh/infra/sysadm-environment/-/issues/4843>`_)

* **2023-04-07** Completed first archival of `Garbaye gitea forge
  <https://git.garbaye.fr/>`_. Regular crawling of their
  repositories enabled (tracking: `#4841
  <https://gitlab.softwareheritage.org/swh/infra/sysadm-environment/-/issues/4841>`_)

* **2023-04-07** Completed first archival of `Alaryso's personal projects gitea forge
  <https://git.alarsyo.net/>`_. Regular crawling of their
  repositories enabled (tracking: `#4833
  <https://gitlab.softwareheritage.org/swh/infra/sysadm-environment/-/issues/4833>`_)

* **2023-04-05** Completed first archival of `Replicant git repositories (split
  in 7 forges) <https://git.replicant.us/>`_. Regular crawling of their
  repositories enabled (tracking: `#4685
  <https://gitlab.softwareheritage.org/swh/infra/sysadm-environment/-/issues/4685>`_)

* **2023-04-03** Completed first archival of `Software Heritage gitlab forge
  <https://gitlab.softwareheritage.org/>`_. Regular crawling of their
  repositories enabled (tracking: `#4683
  <https://gitlab.softwareheritage.org/swh/infra/sysadm-environment/-/issues/4683>`_)

* **2023-03-30** Completed first archival of `CodeAurora, The Global Gathering for
  Mobile Open Source <https://source.codeaurora.org>`_. Regular crawling of its
  repositories enabled (tracking: `#4813
  <https://gitlab.softwareheritage.org/swh/infra/sysadm-environment/-/issues/4813>`_)

* **2023-02-13** Completed first archival of `AFPY (Association Francophone Python)
  git repositories <https://git.afpy.org>`_. Regular crawling of its
  repositories enabled (tracking: `#4674
  <https://gitlab.softwareheritage.org/swh/infra/sysadm-environment/-/issues/4674>`_)

* **2023-01-05** Completed first archival of `the University of Stuttgart gitlab forge
  <https://git.iws.uni-stuttgart.de/>`_. Regular crawling of
  their repositories enabled (tracking: `#4712
  <https://gitlab.softwareheritage.org/swh/infra/sysadm-environment/-/issues/4712>`_)

* **2023-01-05** Completed first archival of `FFDN (Fédération des Fournisseurs
  d'Accès Internet Associatifs) <https://code.ffdn.org/>`_. Regular crawling of
  their repositories enabled (tracking: `#4687
  <https://gitlab.softwareheritage.org/swh/infra/sysadm-environment/-/issues/4687>`_)

* **2023-01-03** Completed first archival of `DeuxFleurs's gitea forge
  <https://git.deuxfleurs.fr>`_, as requested via `Add forge now`_.
  Regular crawling of its repositories enabled
  (tracking: `#4686 <https://gitlab.softwareheritage.org/infra/sysadm-environment/-/issues/4686>`_)

* **2023-01-03** Completed first archival of `Minetest Land's gitea forge
  <https://git.minetest.land>`_, as requested via `Add forge now`_.
  Regular crawling of its repositories enabled
  (tracking: `#4684 <https://gitlab.softwareheritage.org/infra/sysadm-environment/-/issues/4684>`_)

2022
----

* **2022-12-14** Completed first archival of `Université Gustave Eiffel git repositories
  <https://gitlab.univ-eiffel.fr/>`_, as requested via `Add forge now`_.
  Regular crawling of its repositories enabled
  (tracking: `#4675 <https://gitlab.softwareheritage.org/infra/sysadm-environment/-/issues/4675>`_)

* **2022-11-13** Completed first archival of `Jey Hess's git repositories
  <https://git.joeyh.name/>`_, as requested via `Add forge now`_.
  Regular crawling of its repositories enabled
  (tracking: `#4666 <https://gitlab.softwareheritage.org/infra/sysadm-environment/-/issues/4666>`_)

* **2022-11-13** Completed first archival of `Gitlab forge of Université de Lille
  <https://gitlab.univ-lille.fr/explore>`_, as requested via `Add forge now`_.
  Regular crawling of its repositories enabled
  (tracking: `#4668 <https://gitlab.softwareheritage.org/infra/sysadm-environment/-/issues/4668>`_)

* **2022-11-13** Completed first archival of `OpenWork Ltd's and Adrian Cochrane's projects
  <https://git.adrian.geek.nz/>`_, as requested via `Add forge now`_.
  Regular crawling of its repositories enabled
  (tracking: `#4667 <https://gitlab.softwareheritage.org/infra/sysadm-environment/-/issues/4667>`_)

* **2022-11-04** Deployed improvements to the Git loader that result in a 3-5x
  increase in the throughput of Git repository archival. As a result of this
  the crawling frequency of Git repositories will also increase.
  (tracking: `D8808 <https://forge.softwareheritage.org/D8808>`_)

* **2022-11-03** Completed first archival of the `Gentoo forge
  <https://gitweb.gentoo.org/>`_, as requested via `Add forge now`_.
  Regular crawling of its repositories enabled
  (tracking: `#4648 <https://gitlab.softwareheritage.org/infra/sysadm-environment/-/issues/4648>`_)

* **2022-09-27** Completed first archival of the `Gitgud forge
  <https://gitgud.io/>`_, as requested via `Add forge now`_.
  Regular crawling of its repositories enabled
  (tracking: `T4498 <https://forge.softwareheritage.org/T4498>`_)

* **2022-09-27** Completed first archival of the `Madhouse project forge
  <https://git.madhouse-project.org/>`_, as requested via `Add forge now`_.
  Regular crawling of its repositories enabled
  (tracking: `T4500 <https://forge.softwareheritage.org/T4500>`_)

* **2022-09-27** Completed first archival of the `OpenGeoSys forge
  <https://gitlab.opengeosys.org/>`_, as requested via `Add forge now`_.
  Regular crawling of its repositories enabled
  (tracking: `T4499 <https://forge.softwareheritage.org/T4499>`_)

* **2022-09-27** Completed first archival of the `Spork forge
  <https://git.spork.org/>`_, as requested via `Add forge now`_.
  Regular crawling of its repositories enabled
  (tracking: `T4501 <https://forge.softwareheritage.org/T4501>`_)

* **2022-09-27** Completed first archival of `Alex Schroeder's forge
  <https://alexschroeder.ch/cgit>`_, as requested via `Add forge now`_.
  Regular crawling of its repositories enabled
  (tracking: `T4502 <https://forge.softwareheritage.org/T4502>`_)

* **2022-09-27** Completed first archival of the `RWTH Aachen University
  secondary forge <https://git-ce.rwth-aachen.de>`_, as requested via
  `Add forge now`_. Regular crawling of its repositories enabled
  (tracking: `T4504 <https://forge.softwareheritage.org/T4504>`_)

* **2022-09-27** Completed first archival of the `RWTH Aachen University
  forge <https://git.rwth-aachen.de>`_, as requested via `Add forge now`_.
  Regular crawling of its repositories enabled
  (tracking: `T4503 <https://forge.softwareheritage.org/T4503>`_)

* **2022-09-21** Completed first archival of `Case Duckworth's forge
  <https://git.acdw.net/>`_, as requested via `Add forge now`_.
  Regular crawling of its repositories enabled
  (tracking: `T4505 <https://forge.softwareheritage.org/T4505>`_)

.. _Add forge now: https://archive.softwareheritage.org/add-forge/request/list/


2021
----

* **2021-12-11** Completed first archival of the current and historical `Ubuntu
  <https://ubuntu.com/>`_ releases. Regular crawling of those repositories enabled
  (tracking: `T2400 <https://forge.softwareheritage.org/T2400>`_)

* **2021-11-22** Made the package loaders write release objects instead of revisions
  (tracking: `T3638 <https://forge.softwareheritage.org/T3638>`_)

* **2021-11-17:** Completed first archival of the `Opam Coq repository
  <https://coq.inria.fr/opam/released/>`_. Regular crawling of those repositories
  enabled (tracking: `T3717 <https://forge.softwareheritage.org/T3717>`_)

* **2021-10-14:** Completed archival of Bitbucket_ Mercurial repositories
  (tracking: `T3338 <https://forge.softwareheritage.org/T3338>`_)

* **2021-09-25** Completed first archival of the `Opam repository
  <https://opam.ocaml.org>`_. Regular crawling for those repositories
  enabled (tracking: `T3424 <https://forge.softwareheritage.org/T3424>`_)

* **2021-09-23** Completed first archival of the `Logilab Heptapod instance
  <https://forge.extranet.logilab.fr/>`_. Regular crawling for those repositories
  enabled (tracking: `T3597 <https://forge.softwareheritage.org/T3597>`_)

* **2021-09-23** Completed first archival of the `Heptapod instance
  <https://heptapod.host>`_. Regular crawling for those repositories enabled (tracking:
  `T3600 <https://forge.softwareheritage.org/T3600>`_)

* **2021-09-22** Completed first archival of the `FOSS Heptapod instance
  <https://foss.heptapod.net>`_. This is the first forge with mostly mercurial origins.
  Regular crawling for those repositories enabled (tracking: `T3581
  <https://forge.softwareheritage.org/T3581>`_)

* **2021-09-22** Disabled insertion of Git objects with non-canonical representations
  in the SWH data model (tracking: `T399 <https://forge.softwareheritage.org/T399>`_)

* **2021-08-03** Completed first archival of SourceForge Mercurial repositories; regular
  crawling for those repositories enabled (tracking: `T3374
  <https://forge.softwareheritage.org/T3374>`_)

* **2021-07-22** Completed first archival of SourceForge Git and Subversion
  repositories; regular crawling for those repositories enabled (tracking:
  `T3374 <https://forge.softwareheritage.org/T3374>`_)


2020
----

* **2020-10-06 - 2020-11-23:** source code crawlers have been paused to avoid
  an out of disk condition, due to an unexpected delay in the arrival of new
  storage hardware. Push archival (both deposit_ and `save code now`_) remained
  in operation. (tracking: `T2656 <https://forge.softwareheritage.org/T2656>`_)

* **2020-09-15:** completed first archival of, and added to regular crawling
  `GNU Guix System`_ (tracking: `T2594
  <https://forge.softwareheritage.org/T2594>`_)

* **2020-06-11:** completed integration with the IPOL_ journal, allowing paper
  authors to explicitly deposit_ source code to the archive (`announcement
  <https://www.softwareheritage.org/2020/06/11/ipol-and-swh/>`__)

* **2020-05-25:** completed first archival of, and added to regular crawling
  NixOS_ (tracking: `T2411 <https://forge.softwareheritage.org/T2411>`_)


2019
----

* **2019-09-10:** completed first archival of Bitbucket_ Git repositories and
  added Bitbucket as a regularly crawled forge (tracking: `T592
  <https://forge.softwareheritage.org/T592>`_)

* **2019-06-30:** completed first archival of, and added to regular crawling,
  several GitLab_ instances: `0xacab.org <https://0xacab.org>`_, `framagit.org
  <https://framagit.org>`_, `gite.lirmm.fr <https://gite.lirmm.fr>`_,
  `gitlab.common-lisp.net <https://gitlab.common-lisp.net>`_,
  `gitlab.freedesktop.org <https://gitlab.freedesktop.org>`_, `gitlab.gnome.org
  <https://gitlab.gnome.org>`_, `gitlab.inria.fr <https://gitlab.inria.fr>`_,
  `salsa.debian.org <https://salsa.debian.org>`_

* **2019-06-12:** completed first archival of CRAN_ packages and added CRAN as
  a regularly crawled package repository (tracking: `T1709
  <https://forge.softwareheritage.org/T1709>`_)

* **2019-06-11:** completed a full archival of GNU_ source code releases from
  `ftp.gnu.org`_, and added it to regular crawling (tracking: `T1722
  <https://forge.softwareheritage.org/T1722>`_)

* **2019-05-27:** completed a full archival of NPM_ packages and added it as a
  regularly crawled package repository (tracking: `T1378
  <https://forge.softwareheritage.org/T1378>`_)

* **2019-01-10:** enabled the `save code now`_ service, allowing users to
  explicitly request archival of a specific source code repository
  (`announcement
  <https://www.softwareheritage.org/2019/01/10/save_code_now/>`__)


2018
----

* **2018-10-10:** completed first archival of PyPI_ packages and added PyPI as
  a regularly crawled package repository (`announcement
  <https://www.softwareheritage.org/2018/10/10/pypi-available-on-software-heritage/>`__)

* **2018-09-25:** completed integration with HAL_, allowing paper authors to
  explicitly deposit_ source code to the archive (`announcement
  <https://www.softwareheritage.org/2018/09/28/depositing-scientific-software-into-software-heritage/>`__)

* **2018-08-31:** completed first archival of public GitLab_ repositories from
  `gitlab.com <https://gitlab.com>`_ and added it as a regularly crawled forge
  (tracking: `T1111 <https://forge.softwareheritage.org/T1111>`_)

* **2018-03-21:** completed archival of `Google Code`_ Mercurial repositories.
  (tracking: `T682 <https://forge.softwareheritage.org/T682>`_)

* **2018-02-20:** completed archival of Debian_ packages and added Debian as a
  regularly crawled distribution (`announcement
  <https://www.softwareheritage.org/2018/02/20/listing-and-loading-of-debian-repositories-now-live/>`__)


2017
----

* **2017-10-02:** completed archival of `Google Code`_ Subversion repositories
  (tracking: `T617 <https://forge.softwareheritage.org/T617>`_)

* **2017-06-06:** completed archival of `Google Code`_ Git repositories
  (tracking: `T673 <https://forge.softwareheritage.org/T673>`_)


2016
----

* **2016-04-04:** completed archival of the Gitorious_ (tracking: `T312
  <https://forge.softwareheritage.org/T312>`_)


2015
----

* **2015-11-06:** archived all GNU_ source code releases from `ftp.gnu.org`_
  (tracking: `T90 <https://forge.softwareheritage.org/T90>`_)
* **2015-07-28:** started archiving public GitHub_ repositories



.. _Bitbucket: https://bitbucket.org
.. _CRAN: https://cran.r-project.org
.. _Debian: https://www.debian.org
.. _GNU Guix System: https://guix.gnu.org/
.. _GNU: https://en.wikipedia.org/wiki/Google_Code
.. _GitHub: https://github.com
.. _GitLab: https://gitlab.com
.. _Gitorious: https://en.wikipedia.org/wiki/Gitorious
.. _Google Code: https://en.wikipedia.org/wiki/Google_Code
.. _HAL: https://hal.archives-ouvertes.fr
.. _IPOL: http://www.ipol.im
.. _NPM: https://www.npmjs.com
.. _NixOS: https://nixos.org/
.. _PyPI: https://pypi.org
.. _deposit: https://deposit.softwareheritage.org
.. _ftp.gnu.org: http://ftp.gnu.org
.. _save code now: https://save.softwareheritage.org