Import It (Sleep, Repeat)

Import It is an Omeka S module allowing to import repeatedly from various external sources into Omeka S.

The idea is to define a source once in Omeka S, and then import from this source regularly, which can be manual or automatic (using cronjobs for instance).

This is useful for sources that are updated on a regular basis.

The complete documentation of Import It can be found at https://biblibre.github.io/omeka-s-module-ImportIt

Requirements

• Omeka S >= 4.1.0
• PHP >= 8.0

Depending on the sources used, there may be other requirements

Supported sources

Import It currently supports only one source type (more will be added later).

Other modules can add support for other source types.

Server-side METS

A directory on the server containing METS files. METS files may be in subdirectories.

Each METS file will be imported as an item. If it references other files (with fptr) they will be imported as media.

Only dc metadata is supported.

Imported resources are not re-imported on the next runs.

See https://biblibre.github.io/omeka-s-module-ImportIt/en/source-types/server-side-mets.html for more details

Additional requirements

• Local Media Ingester if the referenced files are local (on the Omeka server).

Logs

Import It does not use the default log mechanism, because imports often produce a lot of log messages and that can slow imports down. It can also make the job table grow quickly.

Instead, each import have its own log file on the server. That way they can be rotated with usual tools (eg. logrotate).

They can still be viewed (or downloaded) from the admin interface (until they are rotated).

By default, log files are stored in OMEKA_PATH/logs/importit. It can be changed by adding the following code to config/local.config.php:

    'importit_logger' => [
        'dir' => '/var/log/importit', // Make sure that Omeka have write permissions on this directory
    ],

Start import from the command line

To start an import from the command line (useful to run imports periodically), execute the following command:

$OMEKA_PATH/modules/ImportIt/script/import.php --user-id <user-id> --source-id <source-id>

<user-id> is the ID of an Omeka S user. The import will be run as this user.

<source-id> is the ID of the Import It source.

Contributors / Sponsors

Import It was sponsored by:

• L'École nationale supérieure des mines de Paris

License

Import It is distributed under the GNU General Public License, version 3 (GPLv3). The full text of this license is given in the LICENSE file.