30 KiB
Changelog
All notable changes to this project will be documented in this file. This project adheres to Semantic Versioning and Keep a CHANGELOG.
Unreleased
Added
:implicit_base
option on theRDF.Turtle.Encoder
:base_description
option on theRDF.Turtle.Encoder
0.10.0 - 2021-12-13
This release adds RDF-star support on the RDF data structures, the N-Triples, N-Quads, Turtle encoders and decoders and the BGP query engine. For an introduction read the new page on the RDF.ex guide. For more details on how to migrate from an earlier version read this wiki page.
Elixir versions < 1.10 are no longer supported
Added
- Support for
RDF.PropertyMap
onRDF.Statement.new/2
andRDF.Statement.coerce/2
. RDF.Dataset.graph_count/1
- The
RDF.NQuads.Encoder
now supports a:default_graph_name
option, which allows to specify the graph name to be used as the default for triples from aRDF.Graph
orRDF.Description
.
Changed
- The
RDF.Turtle.Encoder
no longer supports the encoding ofRDF.Dataset
s.
You'll have to aggregate aRDF.Dataset
to aRDF.Graph
on your own now. - The
RDF.NQuads.Encoder
now uses theRDF.Graph.name/1
as the graph name for
the triples of aRDF.Graph
. Previously the triples of anRDF.Graph
were always encoded as part of default graph. You can use the new:default_graph_name
option and set it tonil
to get the old behaviour.
0.9.4 - 2021-05-26
Added
RDF.statement/1
,RDF.statement/3
andRDF.statement/4
constructor functions- the
:default_prefixes
configuration option now allows to set a{mod, fun}
tuple, with a function which should be called to determine the default prefixes - the
:default_base_iri
configuration option now allows to set a{mod, fun}
tuple, with a function which should be called to determine the default base IRI - support for Elixir 1.12 and OTP 24
Fixed
- the Turtle encoder was encoding IRIs as prefixed names even when they were resulting in non-conform prefixed names
- the Turtle encoder didn't properly escape special characters in language-tagged literals
- the N-Triples and N-Quads encoders didn't properly escape special characters in both language-tagged and plain literals
- the
Inspect
protocol implementation forRDF.Diff
was causing an error when both graphs had prefixes defined
Note: In the canonical form of -0.0 in XSD doubles and floats the sign is removed in OTP versions < 24 although this is not standard conform. This has the consequence that the sign of -0.0 is also removed when casting these doubles and floats to decimals. These bugs won't be fixed. If you rely on the correct behavior in these cases, you'll have to upgrade to OTP 24 and a respective Elixir version.
0.9.3 - 2021-03-09
Added
:indent
option onRDF.Turtle.Encoder
, which allows to specify the number of spaces the output should be indented
Changed
- the performance of the
Enumerable
protocol implementations of the RDF data structures was significantly improved (for graphs almost 10x), which in turn increases the performance of all functions built on top of that, eg. the N-Triples and N-Quads encoders - improvement of the Inspect forms of the RDF data structures: the content is now enclosed in angle brackets and indented
Fixed
- strings of the form
".0"
and"0."
weren't recognized as valid XSD float
and double literals - the Turtle encoder handles base URIs without a trailing slash or hash properly
(no longer raising a warning and ignoring them)
0.9.2 - 2021-01-06
Added
RDF.XSD.Base64Binary
datatype (@pukkamustard)
Changed
- a new option
:as_value
to enforce interpretation of an input string as a value instead of a lexical, which is needed on datatypes where the lexical space and the value space both consist of strings RDF.XSD.Date
andRDF.XSD.Time
both can now be initialized with tuples of an ElixirDate
resp.Time
value and a timezone string (previously XSD date and time values with time zones could only be created from strings)
0.9.1 - 2020-11-16
Elixir versions < 1.9 are no longer supported
Added
- general serialization functions for reading from and writing to streams and implementations for N-Triples and N-Quads (Turtle still to come)
- a
:gzip
option flag on allread_file/3
andwrite_file/3
functions allows to read and write all supported serialization formats from and to gzipped files (works also with the new possibility to read and write files via streams) RDF.Dataset.prefixes/1
for getting an aggregatedRDF.PrefixMap
over all graphsRDF.PrefixMap.put/3
for adding a prefix mapping and overwrite an existing oneRDF.BlankNode.value/1
for getting the internal string representation of a blank nodeRDF.IRI.in_namespace?/2
for determining whether an IRI lies in a namespace
Changed
- all
read_file/3
andwrite_file/3
functions onRDF.Serialization
and the modules of RDF serialization formats can use streaming via the:stream
flag option; forread_file/3
andwrite_file/3
it defaults tofalse
, while forread_file!/3
andwrite_file!/3
it defaults totrue
when the respective format supports streams - the Inspect form of the RDF data structures are now Turtle-based and respect
the usual
:limit
behaviour - more compact Inspect form for
RDF.PrefixMap
- the
RDF.Turtle.Encoder
acceptsRDF.Vocabulary.Namespace
modules asbase
- the performance of the
RDF.Turtle.Encoder
was improved (by using a for most use cases more efficient method for resolving IRIs to prefixed names) RDF.BlankNode.new/0
creates integer-based blank nodes, which is much more efficient in terms of performance and memory consumption than the previous ref-based blank nodes
Fixed
RDF.BlankNode
s based on refs weren't serializable to TurtleRDF.Vocabulary.Namespace
s couldn't contain terms conflicting with functions from Elixirs Kernel module; most of them are supported now, while for the
remaining unsupported ones a proper error message is produced during compilation
0.9.0 - 2020-10-13
The API of the all three RDF datastructures RDF.Dataset
, RDF.Graph
and
RDF.Description
were changed, so that the functions taking input data consist only
of one field in order to open the possibility of introducing options on these
functions. The supported ways with which RDF statements can be passed to the
RDF data structures were extended and unified to be supported across all functions
accepting input data. This includes also the way in which patterns for BGP queries
are specified. Also, the performance for adding data has been improved.
For an introduction on the new data structure API and the commonly supported input formats read the updated page on the RDF data structures in the guide. For more details on how to migrate from an earlier version read this wiki page.
Added
RDF.PropertyMap
which allow definition of atoms for RDF properties. Such property maps can be provided to all RDF data structure functions accepting input data and BGP query patterns with the:context
opt, allowing the use of the atoms from the property map in the input data.- on
RDF.Description
RDF.Description.subject/1
RDF.Description.change_subject/2
- on
RDF.Graph
RDF.Graph.name/1
RDF.Graph.change_name/2
RDF.Graph.base_iri/1
RDF.Graph.prefixes/1
RDF.Graph.put_properties/3
- on
RDF.Dataset
RDF.Dataset.name/1
RDF.Dataset.change_name/2
RDF.Dataset.put_properties/3
RDF.IRI.append/2
Changed
- the format for the specification of BGP queries with
RDF.Graph.query/2
,RDF.Graph.query_stream/2
andRDF.Query.bgp/1
has been changed to be consistent
with the supported formats for input data in the rest of the library RDF.Description.new
now requires thesubject
to be passed always as first argument; if you want to add some initial data this must be done with the:init
option- The
put/3
functions onRDF.Graph
andRDF.Dataset
now overwrite all statements with same subject. Previously only statements with the same subject AND predicate were overwritten, which was probably not the expected behaviour, since it's not inline with the commonput
semantics in Elixir. A function with the previous behaviour was added onRDF.Graph
andRDF.Dataset
with theput_properties/3
function.- CAUTION: This means the
RDF.Graph.put/2
andRDF.Dataset.put/2
function have become more destructive now when not specified otherwise. - Note: Although one could argue, that following this route
RDF.Dataset.put/3
would consequently have to overwrite whole graphs, this was not implemented for practical reasons. It's probably not what's wanted in most cases.
- CAUTION: This means the
- The
Access
protocol implementation ofget_and_update/3
onRDF.Graph
andRDF.Dataset
previously relied on theput/2
functions with the old behaviour of overwriting only statements with the same subject and predicate, which was almost never the expected behaviour. This is fixed now by relying on the newput/2
behaviour. - the
values/2
functions ofRDF.Statement
,RDF.Triple
,RDF.Quad
,RDF.Description
,RDF.Graph
andRDF.Dataset
now accept on their second argument an optionalRDF.PropertyMap
which will be used to map predicates accordingly; the variant of thesevalues/2
functions to provide a custom mapping function was extracted into a new functionmap/2
on all of these modules - for consistency reasons the internal
:id
struct field ofRDF.BlankNode
was renamed to:value
- allow the
base_iri
ofRDF.Vocabulary.Namespace
s to end with a.
to support vocabularies which use dots in the IRIs for further structuring (eg. CIM-based formats like CGMES) RDF.Triple.new/1
now also accepts four-element tuples and simple ignores fourth elementRDF.Quad.new/1
now also accepts three-element tuples and simple assumes the fourth element to benil
Fixed
- the
put
functions onRDF.Description
,RDF.Graph
andRDF.Dataset
didn't add all statements properly under certain circumstances RDF.Graph.put/2
ignores empty descriptions; this should be the final piece to ensure thatRDF.Graph
s never contain empty descriptions, which would distort results of functions likeRDF.Graph.subjects/1
,RDF.Graph.subject_count/1
,RDF.Graph.descriptions/1
0.8.2 - 2020-09-21
Added
- the Turtle encoder can now produce partial Turtle documents with the
:only
option and any combination of the following values::triples
,:directives
,:base
,:prefixes
- the style of the Turtle directives produced by the Turtle encoder can be
switched to SPARQL style with the option
:directive_style
and the value:sparql
- the most common conflict resolution strategies on
RDF.PrefixMap.merge/3
can now be chosen directly with the atoms:ignore
and:overwrite
RDF.PrefixMap.prefixed_name/2
to convert an IRI to a prefixed nameRDF.PrefixMap.prefixed_name_to_iri/2
to convert a prefixed name to an IRI
Changed
- when serializing a
RDF.Dataset
with the Turtle encoder the prefixes of all of its graphs are used now
Fixed
- adding an empty
RDF.Description
with a subject to an emptyRDF.Graph
resulted in an invalid non-empty graph (@pukkamustard)
0.8.1 - 2020-06-16
Added
- query functions for basic graph pattern matching (incl. streaming-support)
0.8.0 - 2020-06-01
RDF literals and their datatypes were completely redesigned to support derived XSD datatypes and allow for defining custom datatypes. For an introduction on how literals work now read the updated page on literals in the guide. For more details on how to migrate from an earlier version read this wiki page.
Elixir versions < 1.8 are no longer supported
Added
- a lot of new datatypes like
xsd:float
,xsd:byte
orxsd:anyURI
-- all numeric XSD datatypes are now available; see this page of the API documentation for an up-to-date list of all supported and missing XSD datatypes - an implementation of XSD facet system now makes it easy to define own custom datatypes via restriction of the existing XSD datatypes
RDF.Literal.update/2
updates the value of aRDF.Literal
without changing anything else, eg. the language or datatype
Changed
- the
RDF.Literal
struct now consists entirely of a datatype-specific structs in theliteral
field, which besides being more memory-efficient (since literals no longer consist of all possible fields a literal might have), allows pattern matching now on the datatype of literals. - RDF XSD datatypes are now defined in the
RDF.XSD
namespace - alias constructor functions for the XSD datatypes are now defined on
RDF.XSD
matches?
,less_than?
,greater_than
as higher level functions were removed from theRDF.Literal.Datatype
modulesless_than?
,greater_than?
now always return a boolean and no longernil
when incomparable; you can still determine if two terms are comparable by checking ifcompare/2
returnsnil
- the
language
option is not supported on theRDF.XSD.String.new/2
constructor - the
language
option onRDF.Literal.new/2
is no longer ignored if it's empty (nil
or""
), so this either produces an invalidRDF.LangString
now or, if anotherdatatype
is provided will fail with anArgumentError
canonical
now performs implicit coercions when passed plain Elixir values- the inspect format for literals was changed and is now much more informative and uniform, since you now always see the value, the lexical form and if the literal is valid
RDF.Namespace.resolve_term/1
now returns ok or error tuples, but a new functionRDF.Namespace.resolve_term!/1
with the old behaviour was added
Fixed
- numeric operations on invalid numeric literals no longer fail, but return
nil
instead - Datetimes preserve the original lexical form of the timezone when casting from a date
- BEAM error warnings when trying to use top-level modules as vocabulary terms
0.7.1 - 2020-03-11
Added
- proper typespecs so that Dialyzer passes without warnings (@rustra)
Fixed
RDF.XSD.Time
didn't handle 24h overflows with an offset correctly
0.7.0 - 2019-11-22
Added
RDF.Diff
data structure for diffs between RDF graphs and descriptionsRDF.Description.update/4
updates the objects of a predicate in a description with a custom update functionRDF.Graph.update/4
updates the descriptions of a subject in a graph with a custom update functionRDF.Description.take/2
creates a description from another one by limiting its statements to a set of predicatesRDF.Graph.take/3
creates a graph from another one by limiting its statements to a set of subjects and optionally also a set of predicatesRDF.Graph.clear/1
removes the triples from a graph- Mix formatter configuration for using
defvocab
without parens
Changed
RDF.Serialization.Writer.write_file/4
which is the basis used by all thewrite_file/3
andwrite_file!/3
functions of all serialization format modules likeRDF.NTriples
,RDF.Turtle
,JSON.LD
etc. now opens file in a different mode: it no longer opens them with the:utf8
option. First, this by default slowed down the writing, but more importantly could lead to unexpected encoding issues. This is a breaking change: If your code relied on this file mode, you can get the old behaviour, by specifying thefile_mode
on these functions accordingly as[:utf8, :write, :exclusive]
. For example, to write a Turtle file with the old behaviour, you can do it like this:
RDF.Turtle.write_file!(some_data, some_path, file_mode: ~w[utf8 write exclusive]a)
0.6.2 - 2019-09-08
Added
- field
base_iri
onRDF.Graph
structure which can be set via newbase_iri
option onRDF.Graph.new
or the new functionsRDF.Graph.set_base_iri/2
andRDF.Graph.clear_base_iri/1
RDF.Graph.clear_metadata/1
which clears the base IRI and the prefixesRDF.IRI.coerce_base/1
which coerces base IRIs; as opposed toRDF.IRI.new/1
it also accepts bareRDF.Vocabulary.Namespace
modules
Changed
RDF.Turtle.Decoder
saves the base IRI in theRDF.Graph
nowRDF.Turtle.Encoder
now takes the base IRI to be used during serialization in
the following order of precedence:- from the
base
option or its new aliasbase_iri
- from the
base_iri
field of the given graph - from the
RDF.default_base_iri
returning the one from the application configuration
- from the
RDF.PrefixMap.new
andRDF.PrefixMap.add
now also accepts terms fromRDF.Vocabulary.Namespace
s as namespaces
Fixed
- Vocabulary namespace modules weren't always detected properly
0.6.1 - 2019-07-15
Added
RDF.IRI.to_string/1
returns the string representation of anRDF.IRI
(implicitly resolving vocabulary namespace terms)RDF.Literal.matches?/3
for XQuery regex pattern matchingRDF.Decimal.digit_count/1
andRDF.Decimal.fraction_digit_count/1
for
determining the number of digits of decimal literals
Fixed
- language literals were not properly unescaped during Turtle parsing
RDF.Literal.new/1
can take decimals and infers the datatypexsd:decimal
correctlytrue
andfalse
with capital letters are no longer validRDF.Boolean
s following the XSD specification; the same applies for booleans in Turtle+INF
is no longer a validRDF.Double
(positive infinity doesn't expect a sign)- slightly improve output of errors during parsing of Turtle, N-Triples and N-Quads
0.6.0 - 2019-04-06
see here for upgrading notes to RDF.ex 0.6
Added
RDF.PrefixMap
- prefix management of
RDF.Graph
s:- the structure now has a
prefixes
field with an optionalRDF.PrefixMap
- new functions
add_prefixes/2
,delete_prefixes/2
andclear_prefixes/1
- the structure now has a
- configurable
RDF.default_prefixes
RDF.Description.equal?/2
,RDF.Graph.equal?/2
,RDF.Dataset.equal?/2
andRDF.Data.equal?/2
Changed
- the constructor functions for
RDF.Graph
s andRDF.Dataset
s now take the graph name resp. dataset name through aname
option, instead of the first argument RDF.Graph.new
supports an additionalprefixes
argument to initialize theprefixes
field- when
RDF.Graph.add
andRDF.Graph.put
are called with another graph, its prefixes are merged RDF.Turtle.Decoder
saves the prefixes nowRDF.Turtle.Encoder
now takes the prefixes to be serialized in the following order of precedence:- from the
prefixes
option (as before) - from the
prefixes
field of the given graph - from the
RDF.default_prefixes
- from the
- drop support for OTP < 20, since prefixes can consist of UTF characters which are not supported in atoms on these versions
0.5.4 - 2019-01-17
Fixed
- issue with Elixir 1.8
RDF.write_file
andRDF.write_file!
delegators had wrong signatures
0.5.3 - 2018-11-11
Added
RDF.Triple.valid?/1
,RDF.Quad.valid?/1
andRDF.Statement.valid?/1
, which validate if a tuple is a valid RDF triple or RDF quad
0.5.2 - 2018-11-04
Added
RDF.Term.value/1
returning the native Elixir value of a RDF termRDF.Statement.values/1
,RDF.Triple.values/1
andRDF.Quad.values/1
returning a tuple ofRDF.Term.value/1
converted native Elixir values from a tuple of RDF termsRDF.Description.values/1
,RDF.Graph.values/1
,RDF.Dataset.values/1
andRDF.Data.values/1
returning a map ofRDF.Term.value/1
converted native Elixir values from the respective structure of RDF terms- for all of aforementioned
values/1
functions a variantvalues/2
which allows to specify custom mapping function to be applied when creating the resp. structure RDF.Literal.compare/2
,RDF.Literal.less_than?/2
andRDF.Literal.greater_than?/2
forRDF.Datatype
aware comparisons ofRDF.Literal
s
Fixed
RDF.DateTime.equal_value?/2
andRDF.Date.equal_value?/2
did not handle timezones correctly-00:00
is a valid timezone offset onRDF.DateTime
0.5.1 - 2018-09-17
Fixed
- generated Erlang output files of Leex and Yecc are excluded from Hex package
0.5.0 - 2018-09-17
Elixir versions < 1.6 are no longer supported
Added
- Possibility to execute simple SPARQL queries against
RDF.Graph
s with SPARQL 0.2 - New
RDF.Term
protocol implemented for all structs representing RDF nodes and
all native Elixir datatypes which are coercible to those modules. For now, it
mainly offers, besides the coercion, just the functionRDF.Term.equal?/2
andRDF.Term.equal_value?/2
for term- and value comparisons. - New
RDF.Decimal
datatype forxsd:decimal
literals and support for decimal literals in Turtle encoder RDF.Numeric
module with a list of all numeric datatypes and shared functions for all numeric literals, eg. arithmetic functions- Various new
RDF.Datatype
functionRDF.Datatype.cast/1
for casting betweenRDF.Literal
s as specified in the XSD spec on allRDF.Datatype
s- logical operators and the Effective Boolean Value (EBV) coercion algorithm
from the XPath and SPARQL specs on
RDF.Boolean
- various functions on the
RDF.DateTime
andRDF.Time
datatypes RDF.LangString.match_language?/2
- Many new convenience functions on the top-level
RDF
module- constructors for all of the supported
RDF.Datatype
s - constant functions
RDF.true
andRDF.false
for the two booleanRDF.Literal
values
- constructors for all of the supported
RDF.Literal.Guards
which allow pattern matching of common literal datatypesRDF.BlankNode.Generator
- Possibility to configure an application-specific default base IRI; for now it
is used only on reading of RDF serializations (when no
base
specified)
Changed
RDF.String.new/2
andRDF.String.new!/2
produce ardf:langString
when given a language tag- Some of the defined structs now enforce keys on compile-time (via Elixirs
@enforce_keys
feature) when not setting the corresponding fields would lead to invalid structs, namely the following fields:RDF.IRI.value
RDF.BlankNode.id
RDF.Description.subject
RDF.List.head
Fixed
RDF.resource?/1
does not fail anymore when called with unresolvable atoms but returnsfalse
insteadRDF.IRI.absolute/2
does not fail with aFunctionClauseError
when the given base is not absolute, but returnsnil
insteadRDF.DateTime
andRDF.Time
store microsecondsRDF.DateTime
: '24:00:00' is a valid time in a xsd:dateTime; the dateTime value so represented is the first instant of the following dayRDF.LangString
: non-strings or the empty string as language produce invalid literals
0.4.1 - 2018-03-19
Added
RDF.Literal.new!/2
which fails when creating an invalid literal
Changed
RDF.Literal.new/2
can createrdf:langString
literals without failing, they
are simply invalid; if you want to fail without a language tag use the newRDF.Literal.new!/2
function
0.4.0 - 2018-03-10
Changed
- renamed
RDF.Serialization
behaviour toRDF.Serialization.Format
; the newRDF.Serialization
module contains just simple RDF serialization related functions - renamed
RDF.Serialization.Format
functioncontent_type/0
tomedia_type/0
- moved
RDF.Reader
andRDF.Writer
intoRDF.Serialization
module - removed the limitation to serialization formats defined in the core RDF.ex package
for use as a source of
RDF.Vocabulary.Namespace
s; so you can now also define vocabulary namespaces from JSON-LD files for example, provided that the corresponding Hex package is defined as a dependency
Added
RDF.Serialization.Format
s define aname
atom- all
RDF.Serialization.Reader
andRDF.Serialization.Writer
functions are now available on theRDF.Serialization
module (or aliased on the top-levelRDF
module) and the format can be specified instead of aRDF.Serialization.Format
argument, via theformat
ormedia_type
option or in case of*_file
functions, without explicit specification of the format, but inferred from file name extension instead; see the updated README section about RDF serializations - the following functions to access available
RDF.Serialization.Format
s:RDF.Serialization.formats/0
RDF.Serialization.available_formats/0
RDF.Serialization.format/1
RDF.Serialization.format_by_media_type/1
RDF.Serialization.format_by_extension/1
0.3.1 - 2018-01-19
Added
Collectable
implementations for allRDF.Data
structures so they can be used as destinations ofEnum.into
andfor
comprehensions
Fixed
- Fix
unescape_map
inparse_helper
for Elixir 1.6 (@ajkeys)
0.3.0 - 2017-08-24
Added
RDF.IRI
as a more suitable URI/IRI representation for RDF, bringing enormous performance and memory consumption benefits (see here for the details about the improvements)
Changed
- use
RDF.IRI
instead of ElixirsURI
everywhere - use the term iri instead of uri consistently, leading to the following
function renamings:
base_iri
instead ofbase_uri
for the definition ofRDF.Vocabulary.Namespace
s__base_iri__
instead of__base_uri__
in allRDF.Vocabulary.Namespace
s__iris__
instead of__uris__
in allRDF.Vocabulary.Namespace
sRDF.IRI.InvalidError
instead ofRDF.InvalidURIError
RDF.Literal.InvalidError
instead ofRDF.InvalidLiteralError
RDF.Namespace.InvalidVocabBaseIRIError
instead ofRDF.Namespace.InvalidVocabBaseURIError
- show compilation message of vocabulary namespaces always to be able to relate resp. errors and warnings
Fixed
- when trying to resolve a term from an undefined module a
RDF.Namespace.UndefinedTermError
exception
0.2.0 - 2017-08-12
Elixir versions < 1.4 are no longer supported
Added
- full Turtle support
RDF.List
structure for the representation of RDF listsdescribes?/1
onRDF.Data
protocol and all RDF data structures which checks
if statements about a given resource existRDF.Data.descriptions/1
which returns all descriptions within a RDF data structureRDF.Description.first/2
which returns a single object to a predicate of aRDF.Description
RDF.Description.objects/2
now supports a custom filter functionRDF.bnode?/1
which checks if the given value is a blank node
Changed
- Rename
RDF.Statement.convert*
functions toRDF.Statement.coerce*
Fixed
RDF.uri/1
and URI parsing of N-Triples and N-Quads decoders preserve empty fragments- booleans weren't recognized as coercible literals on object positions
- N-Triples and N-Quads decoder didn't handle escaping properly
0.1.1 - 2017-06-25
Fixed
- Add
src
directory to package files.
0.1.0 - 2017-06-25
Initial release
Note: This version is not usable, since the src
directory is not part of the
package, which has been immediately fixed on version 0.1.1.