2015-07-22 07:09:51 -07:00
|
|
|
.. _sql-tab:
|
|
|
|
|
|
|
|
|
|
SQLite Tables Reference
|
|
|
|
|
=======================
|
|
|
|
|
|
|
|
|
|
In addition to the tables generated for each log format, **lnav** includes
|
2020-04-21 21:04:03 -07:00
|
|
|
the following tables/views:
|
2015-07-22 07:09:51 -07:00
|
|
|
|
2020-05-07 07:08:59 -07:00
|
|
|
* `environ`_
|
2023-09-02 22:35:15 -07:00
|
|
|
* `fstat(<path|pattern>)`_
|
2022-06-09 12:49:06 -07:00
|
|
|
* `lnav_events`_
|
2020-05-07 07:08:59 -07:00
|
|
|
* `lnav_file`_
|
2023-06-29 14:58:51 -07:00
|
|
|
* `lnav_file_metadata`_
|
2026-04-04 08:06:28 -07:00
|
|
|
* `lnav_log_breakpoints`_
|
2022-08-11 00:15:18 -07:00
|
|
|
* `lnav_user_notifications`_
|
2020-05-07 07:08:59 -07:00
|
|
|
* `lnav_views`_
|
2022-08-11 00:15:18 -07:00
|
|
|
* `lnav_views_echo`_
|
2023-06-29 14:58:51 -07:00
|
|
|
* `lnav_view_files`_
|
2020-05-07 07:08:59 -07:00
|
|
|
* `lnav_view_stack`_
|
|
|
|
|
* `lnav_view_filters`_
|
|
|
|
|
* `lnav_view_filter_stats`_
|
|
|
|
|
* `lnav_view_filters_and_stats`_
|
2025-03-25 10:43:27 -07:00
|
|
|
* `lnav_top_view`_
|
2020-05-07 07:08:59 -07:00
|
|
|
* `all_logs`_
|
2025-11-15 07:32:32 -08:00
|
|
|
* `all_opids`_
|
|
|
|
|
* `all_thread_ids`_
|
2025-03-25 10:43:27 -07:00
|
|
|
* `lnav_focused_msg`_
|
2020-05-07 07:08:59 -07:00
|
|
|
* `http_status_codes`_
|
|
|
|
|
* `regexp_capture(<string>, <regex>)`_
|
2015-07-22 07:09:51 -07:00
|
|
|
|
|
|
|
|
These extra tables provide useful information and can let you manipulate
|
|
|
|
|
**lnav**'s internal state. You can get a dump of the entire database schema
|
|
|
|
|
by executing the '.schema' SQL command, like so::
|
|
|
|
|
|
|
|
|
|
;.schema
|
|
|
|
|
|
2025-10-09 13:22:31 -07:00
|
|
|
.. note::
|
|
|
|
|
The tables created by lnav are in the :code:`lnav_db` database. The
|
|
|
|
|
:code:`main` SQLite database is left empty for your own use. If you
|
|
|
|
|
end up creating any tables while processing your logs, you can use
|
|
|
|
|
the :ref:`dot_save` SQL command to save the :code:`main` database to
|
|
|
|
|
a SQLite database file.
|
|
|
|
|
|
2015-07-22 07:09:51 -07:00
|
|
|
environ
|
|
|
|
|
-------
|
|
|
|
|
|
2023-09-02 22:35:15 -07:00
|
|
|
The :code:`environ` table gives you access to the **lnav** process' environment
|
2023-06-29 14:58:51 -07:00
|
|
|
variables. You can :code:`SELECT`, :code:`INSERT`, and :code:`UPDATE`
|
|
|
|
|
environment variables, like so:
|
2020-05-07 07:08:59 -07:00
|
|
|
|
2020-05-18 07:10:07 -07:00
|
|
|
.. code-block:: custsqlite
|
2015-07-22 07:09:51 -07:00
|
|
|
|
|
|
|
|
;SELECT * FROM environ WHERE name = 'SHELL'
|
|
|
|
|
name value
|
|
|
|
|
SHELL /bin/tcsh
|
|
|
|
|
|
|
|
|
|
;UPDATE environ SET value = '/bin/sh' WHERE name = 'SHELL'
|
|
|
|
|
|
|
|
|
|
Environment variables can be used to store simple values or pass values
|
|
|
|
|
from **lnav**'s SQL environment to **lnav**'s commands. For example, the
|
2023-06-29 14:58:51 -07:00
|
|
|
:code:`:open` command will do variable substitution, so you can insert a variable
|
2015-07-22 07:09:51 -07:00
|
|
|
named "FILENAME" and then open it in **lnav** by referencing it with
|
2020-05-07 07:08:59 -07:00
|
|
|
"$FILENAME":
|
|
|
|
|
|
2020-05-18 07:10:07 -07:00
|
|
|
.. code-block:: custsqlite
|
2015-07-22 07:09:51 -07:00
|
|
|
|
|
|
|
|
;INSERT INTO environ VALUES ('FILENAME', '/path/to/file')
|
|
|
|
|
:open $FILENAME
|
|
|
|
|
|
2020-04-21 21:04:03 -07:00
|
|
|
|
2023-09-02 22:35:15 -07:00
|
|
|
fstat(<path|pattern>)
|
|
|
|
|
---------------------
|
|
|
|
|
|
|
|
|
|
The :code:`fstat` table-valued function provides access to the local
|
|
|
|
|
file system. The function takes a file path or a glob pattern and
|
|
|
|
|
returns the results of :code:`lstat(2)` for the matching files. If
|
|
|
|
|
the parameter is a pattern that matches nothing, no rows will be
|
|
|
|
|
returned. If the parameter is a path for a non-existent file, a
|
|
|
|
|
row will be returned with the :code:`error` column set and the
|
|
|
|
|
stat columns as :code:`NULL`. To read the contents of a file, you
|
|
|
|
|
can :code:`SELECT` the hidden :code:`data` column.
|
|
|
|
|
|
|
|
|
|
|
2022-06-09 12:49:06 -07:00
|
|
|
.. _table_lnav_events:
|
|
|
|
|
|
|
|
|
|
lnav_events
|
|
|
|
|
-----------
|
|
|
|
|
|
2023-06-29 14:58:51 -07:00
|
|
|
The :code:`lnav_events` table allows you to react to events that occur while
|
2022-06-09 12:49:06 -07:00
|
|
|
**lnav** is running using SQLite triggers. For example, when a file is
|
|
|
|
|
opened, a row is inserted into the :code:`lnav_events` table that contains
|
|
|
|
|
a timestamp and a JSON object with the event ID and the path of the file.
|
|
|
|
|
The following columns are available in this table:
|
|
|
|
|
|
|
|
|
|
:ts: The timestamp of the event.
|
|
|
|
|
:content: A JSON object that contains the event information. See the
|
|
|
|
|
:ref:`event_reference` for more information about the types
|
|
|
|
|
of events that are available.
|
|
|
|
|
|
2020-04-21 21:04:03 -07:00
|
|
|
lnav_file
|
|
|
|
|
---------
|
|
|
|
|
|
2023-06-29 14:58:51 -07:00
|
|
|
The :code:`lnav_file` table allows you to examine and perform limited updates to
|
2020-04-21 21:04:03 -07:00
|
|
|
the metadata for the files that are currently loaded into **lnav**. The
|
|
|
|
|
following columns are available in this table:
|
|
|
|
|
|
|
|
|
|
:device: The device the file is stored on.
|
|
|
|
|
:inode: The inode for the file on the device.
|
2020-04-25 07:32:05 -07:00
|
|
|
:filepath: If this is a real file, it will be the absolute path. Otherwise,
|
2023-09-13 14:58:59 -07:00
|
|
|
it is a symbolic name. If it is a symbolic name, it can be UPDATEd
|
|
|
|
|
so that this file will be considered when saving and loading session
|
|
|
|
|
information.
|
|
|
|
|
:mimetype: The detected MIME type of the file.
|
|
|
|
|
:content_id: The hash of some unique content in the file.
|
2020-04-21 21:04:03 -07:00
|
|
|
:format: The log file format for the file.
|
|
|
|
|
:lines: The number of lines in the file.
|
|
|
|
|
:time_offset: The millisecond offset for timestamps. This column can be
|
|
|
|
|
UPDATEd to change the offset of timestamps in the file.
|
2023-09-13 14:58:59 -07:00
|
|
|
:options_path: Options can be applied to files based on a path or glob
|
|
|
|
|
pattern. If this file matches a set of options, the matching path/pattern
|
|
|
|
|
is available in this column and the actual options themselves are in the
|
|
|
|
|
:code:`options` column.
|
|
|
|
|
:options: The options that are applicable to this file. Currently, the
|
|
|
|
|
only options available are for the timezone set by the
|
|
|
|
|
:ref:`:set-file-timezone<set_file_timezone>` command.
|
2020-04-21 21:04:03 -07:00
|
|
|
|
2023-06-29 14:58:51 -07:00
|
|
|
lnav_file_metadata
|
|
|
|
|
------------------
|
|
|
|
|
|
|
|
|
|
The :code:`lnav_file_metadata` table gives access to metadata associated with a
|
|
|
|
|
loaded file. Currently,
|
|
|
|
|
|
|
|
|
|
:filepath: The path to the file.
|
|
|
|
|
:descriptor: A descriptor that identifies the source of the metadata. The
|
|
|
|
|
following descriptors are supported:
|
|
|
|
|
|
|
|
|
|
:net.zlib.gzip.header: The header on a gzipped file. The content is a
|
|
|
|
|
JSON object with the following properties:
|
|
|
|
|
|
|
|
|
|
:name: The original name of the file.
|
|
|
|
|
:mtime: The last modified time of the file when it was compressed.
|
|
|
|
|
:comment: A text comment associated with the file.
|
|
|
|
|
:net.daringfireball.markdown.frontmatter: The frontmatter on a
|
|
|
|
|
markdown file. If the frontmatter is delimited by three dashes
|
|
|
|
|
(:code:`---`), the :code:`mimetype` will be :code:`application/yaml`.
|
|
|
|
|
If the frontmatter is delimited by three pluses (:code:`+++`) the
|
|
|
|
|
:code:`mimetype` will be :code:`application/toml`.
|
|
|
|
|
:mimetype: The MIME type of the metadata.
|
|
|
|
|
:content: The metadata itself.
|
|
|
|
|
|
2026-04-04 08:06:28 -07:00
|
|
|
|
|
|
|
|
.. _table_lnav_log_breakpoints:
|
|
|
|
|
|
|
|
|
|
lnav_log_breakpoints
|
|
|
|
|
--------------------
|
|
|
|
|
|
|
|
|
|
The :code:`lnav_log_breakpoints` table allows you to view and manage
|
|
|
|
|
breakpoints set on log messages. Breakpoints mark log messages that
|
|
|
|
|
share a particular source file location or message schema, making it
|
|
|
|
|
easy to navigate between related log lines using the :kbd:`F7` and
|
|
|
|
|
:kbd:`F8` keys.
|
|
|
|
|
|
|
|
|
|
You can :code:`SELECT`, :code:`INSERT`, :code:`UPDATE`, and
|
|
|
|
|
:code:`DELETE` breakpoints through this table. The columns in the
|
|
|
|
|
table are as follows:
|
|
|
|
|
|
|
|
|
|
:schema_id: The schema identifier for the breakpoint. This value
|
|
|
|
|
matches the :code:`log_msg_schema` column in the :code:`all_logs`
|
|
|
|
|
table.
|
|
|
|
|
:description: A human-readable description of the breakpoint
|
|
|
|
|
(e.g. :code:`format_name:file.cc:42`).
|
|
|
|
|
:type: The source of the schema ID, either :code:`src_location` or
|
|
|
|
|
:code:`message_schema`.
|
|
|
|
|
:enabled: Indicates whether the breakpoint is active (1 or 0).
|
|
|
|
|
|
|
|
|
|
.. code-block:: custsqlite
|
|
|
|
|
|
|
|
|
|
;SELECT * FROM lnav_log_breakpoints
|
|
|
|
|
|
|
|
|
|
;UPDATE lnav_log_breakpoints SET enabled = 0 WHERE description LIKE '%main.cc%'
|
|
|
|
|
|
|
|
|
|
;DELETE FROM lnav_log_breakpoints WHERE description LIKE '%test%'
|
|
|
|
|
|
|
|
|
|
|
2022-08-11 00:15:18 -07:00
|
|
|
.. _table_lnav_user_notifications:
|
|
|
|
|
|
|
|
|
|
lnav_user_notifications
|
|
|
|
|
-----------------------
|
|
|
|
|
|
|
|
|
|
The :code:`lnav_user_notifications` table allows you to display a custom message
|
|
|
|
|
in the top-right corner of the UI. For example, to display "Hello, World!",
|
|
|
|
|
you can enter:
|
|
|
|
|
|
|
|
|
|
.. code-block:: custsqlite
|
|
|
|
|
|
|
|
|
|
;REPLACE INTO lnav_user_notifications (message) VALUES ('Hello, World!')
|
|
|
|
|
|
|
|
|
|
There are additional columns to have finer control of what is displayed and
|
|
|
|
|
when:
|
|
|
|
|
|
|
|
|
|
:id: The unique ID for the message, defaults to "org.lnav.user". This is
|
|
|
|
|
the primary key for the table, so more than one type of message is not
|
|
|
|
|
allowed.
|
|
|
|
|
:priority: The priority of the message. Higher priority messages will be
|
|
|
|
|
displayed until they are cleared or are expired.
|
|
|
|
|
:created: The time the message was created.
|
|
|
|
|
:expiration: The time when the message should expire or NULL if it should
|
|
|
|
|
not automatically expire.
|
|
|
|
|
:views: A JSON array of view names where the message is applicable or NULL
|
|
|
|
|
if the message should be shown in all views.
|
|
|
|
|
:message: The message itself.
|
|
|
|
|
|
|
|
|
|
This table will most likely be used in combination with :ref:`Events` and the
|
|
|
|
|
`lnav_views_echo`_ table.
|
|
|
|
|
|
2015-07-22 07:09:51 -07:00
|
|
|
lnav_views
|
|
|
|
|
----------
|
|
|
|
|
|
2023-06-29 14:58:51 -07:00
|
|
|
The :code:`lnav_views` table allows you to SELECT and UPDATE information related
|
2015-07-22 07:09:51 -07:00
|
|
|
to **lnav**'s "views" (e.g. log, text, ...). The following columns are
|
|
|
|
|
available in this table:
|
|
|
|
|
|
2022-12-14 21:52:24 -08:00
|
|
|
:name: The name of the view.
|
|
|
|
|
:top: The line number at the top of the view. This value can be UPDATEd to
|
|
|
|
|
move the view to the given line.
|
|
|
|
|
:left: The left-most column number to display. This value can be UPDATEd to
|
|
|
|
|
move the view left or right.
|
|
|
|
|
:height: The number of lines that are displayed on the screen.
|
|
|
|
|
:inner_height: The number of lines of content being displayed.
|
|
|
|
|
:top_time: The timestamp of the top line in the view or NULL if the view is
|
|
|
|
|
not time-based. This value can be UPDATEd to move the view to the given
|
|
|
|
|
time.
|
2023-06-20 21:11:27 -07:00
|
|
|
:top_file: The file the top line in the view is from.
|
2022-12-14 21:52:24 -08:00
|
|
|
:paused: Indicates if the view is paused and will not load new data.
|
|
|
|
|
:search: The search string for this view. This value can be UPDATEd to
|
|
|
|
|
initiate a text search in this view.
|
|
|
|
|
:filtering: Indicates if the view is applying filters.
|
|
|
|
|
:movement: The movement mode, either 'top' or 'cursor'.
|
2023-06-20 21:11:27 -07:00
|
|
|
:top_meta: A JSON object that contains metadata related to the top line
|
|
|
|
|
in the view.
|
|
|
|
|
:selection: The number of the line that is focused for selection.
|
2023-08-15 16:34:33 -07:00
|
|
|
:options: A JSON object that contains optional settings for this view.
|
2017-03-04 15:22:19 -08:00
|
|
|
|
2022-08-11 00:15:18 -07:00
|
|
|
lnav_views_echo
|
|
|
|
|
---------------
|
|
|
|
|
|
|
|
|
|
The :code:`lnav_views_echo` table is a real SQLite table that you can create
|
|
|
|
|
TRIGGERs on in order to react to users moving around in a view.
|
|
|
|
|
|
|
|
|
|
.. note::
|
|
|
|
|
|
|
|
|
|
The table is periodically updated to reflect the current state of the views.
|
|
|
|
|
The changes are *not* performed immediately after the user action.
|
|
|
|
|
|
2023-06-29 14:58:51 -07:00
|
|
|
lnav_view_files
|
|
|
|
|
---------------
|
|
|
|
|
|
|
|
|
|
The :code:`lnav_view_files` table provides access to details about the files
|
|
|
|
|
displayed in a particular view. The main purpose of this table is to allow
|
|
|
|
|
you to programmatically control which files are shown / hidden in the view.
|
|
|
|
|
The following columns are available in this table:
|
|
|
|
|
|
|
|
|
|
:view_name: The name of the view.
|
|
|
|
|
:filepath: The file's path.
|
|
|
|
|
:visible: Determines whether the file is visible in the view. This column
|
|
|
|
|
can be changed using an :code:`UPDATE` statement to hide or show the file.
|
|
|
|
|
|
2017-03-04 15:22:19 -08:00
|
|
|
lnav_view_stack
|
|
|
|
|
---------------
|
|
|
|
|
|
2023-06-29 14:58:51 -07:00
|
|
|
The :code:`lnav_view_stack` table allows you to :code:`SELECT` and :code:`DELETE`
|
|
|
|
|
from the stack of **lnav** "views" (e.g. log, text, ...). The following columns
|
|
|
|
|
are available in this table:
|
2017-03-04 15:22:19 -08:00
|
|
|
|
|
|
|
|
:name: The name of the view.
|
2015-07-22 07:09:51 -07:00
|
|
|
|
2020-08-24 22:50:48 -07:00
|
|
|
.. _table_lnav_view_filters:
|
|
|
|
|
|
2018-11-09 09:45:19 -08:00
|
|
|
lnav_view_filters
|
|
|
|
|
-----------------
|
|
|
|
|
|
2023-06-29 14:58:51 -07:00
|
|
|
The :code:`lnav_view_filters` table allows you to manipulate the filters in the
|
2018-11-09 09:45:19 -08:00
|
|
|
**lnav** views. The following columns are available in this table:
|
|
|
|
|
|
2020-04-21 21:04:03 -07:00
|
|
|
:view_name: The name of the view the filter is applied to.
|
|
|
|
|
:filter_id: The filter identifier. This will be assigned on insertion.
|
2018-11-09 09:45:19 -08:00
|
|
|
:enabled: Indicates whether this filter is enabled or disabled.
|
|
|
|
|
:type: The type of filter, either 'in' or 'out'.
|
|
|
|
|
:pattern: The regular expression to filter on.
|
|
|
|
|
|
2023-06-29 14:58:51 -07:00
|
|
|
This table supports :code:`SELECT`, :code:`INSERT`, :code:`UPDATE`, and
|
|
|
|
|
:code:`DELETE` on the table rows to read, create, update, and delete
|
|
|
|
|
filters for the views.
|
2020-04-21 21:04:03 -07:00
|
|
|
|
|
|
|
|
lnav_view_filter_stats
|
|
|
|
|
----------------------
|
|
|
|
|
|
2023-06-29 14:58:51 -07:00
|
|
|
The :code:`lnav_view_filter_stats` table allows you to get information about how
|
2020-04-21 21:04:03 -07:00
|
|
|
many lines matched a given filter. The following columns are available in
|
|
|
|
|
this table:
|
|
|
|
|
|
|
|
|
|
:view_name: The name of the view.
|
|
|
|
|
:filter_id: The filter identifier.
|
|
|
|
|
:hits: The number of lines that matched this filter.
|
|
|
|
|
|
|
|
|
|
This table is read-only.
|
|
|
|
|
|
|
|
|
|
lnav_view_filters_and_stats
|
|
|
|
|
---------------------------
|
|
|
|
|
|
2023-06-29 14:58:51 -07:00
|
|
|
The :code:`lnav_view_filters_and_stats` view joins the :code:`lnav_view_filters`
|
|
|
|
|
table with the :code:`lnav_view_filter_stats` table into a single view for ease of use.
|
2020-04-21 21:04:03 -07:00
|
|
|
|
2025-03-25 10:43:27 -07:00
|
|
|
lnav_top_view
|
|
|
|
|
-------------
|
|
|
|
|
|
|
|
|
|
The :code:`lnav_top_view` view returns the row for the top view on the view stack.
|
|
|
|
|
|
2015-07-22 07:09:51 -07:00
|
|
|
all_logs
|
|
|
|
|
--------
|
|
|
|
|
|
2022-03-31 08:59:19 -07:00
|
|
|
.. f0:sql.tables.all_logs
|
|
|
|
|
|
2023-06-29 14:58:51 -07:00
|
|
|
The :code:`all_logs` table lets you query the format derived from the **lnav**
|
2015-07-22 07:09:51 -07:00
|
|
|
log message parser that is used to automatically extract data, see
|
|
|
|
|
:ref:`data-ext` for more details.
|
|
|
|
|
|
2025-10-03 22:55:09 -07:00
|
|
|
all_opids
|
|
|
|
|
---------
|
|
|
|
|
|
|
|
|
|
The :code:`all_opids` table contains information about all opids that were
|
|
|
|
|
found in the log files or set via the :code:`log_opid` column on the log
|
|
|
|
|
vtables. The information in this table is the same as available through the
|
|
|
|
|
:ref:`TIMELINE<timeline>` view. The :code:`description` column can be
|
|
|
|
|
:code:`SET` in an :code:`UPDATE` statement to customize the description
|
|
|
|
|
shown in the timeline.
|
|
|
|
|
|
2025-10-04 09:58:49 -07:00
|
|
|
all_thread_ids
|
|
|
|
|
--------------
|
|
|
|
|
|
|
|
|
|
The :code:`all_thread_ids` table contains information about all the thread
|
|
|
|
|
identifiers that were found in logs. Log formats can specify which field
|
|
|
|
|
is a thread identifier with the :code:`thread-id-field` property.
|
|
|
|
|
|
2025-03-25 10:43:27 -07:00
|
|
|
lnav_focused_msg
|
|
|
|
|
----------------
|
|
|
|
|
|
|
|
|
|
The :code:`lnav_focused_msg` view returns the row for the focused log
|
|
|
|
|
message from the :code:`all_logs` table.
|
|
|
|
|
|
2015-07-22 07:09:51 -07:00
|
|
|
http_status_codes
|
|
|
|
|
-----------------
|
|
|
|
|
|
2023-06-29 14:58:51 -07:00
|
|
|
The :code:`http_status_codes` table is a handy reference that can be used to turn
|
2015-07-22 07:09:51 -07:00
|
|
|
HTTP status codes into human-readable messages.
|
2017-03-15 17:01:58 -07:00
|
|
|
|
|
|
|
|
regexp_capture(<string>, <regex>)
|
|
|
|
|
---------------------------------
|
|
|
|
|
|
2023-06-29 14:58:51 -07:00
|
|
|
The :code:`regexp_capture()` table-valued function applies the regular expression
|
2017-03-15 17:01:58 -07:00
|
|
|
to the given string and returns detailed results for the captured portions of
|
|
|
|
|
the string.
|
