From 5ee26d56330d24d3684bf8bab269bc285490fed0 Mon Sep 17 00:00:00 2001 From: Philip Sampaio Date: Wed, 23 Oct 2024 20:39:54 -0300 Subject: [PATCH] Release v0.10.0 (#1008) * Release v0.10.0 * Add note about cut/qcut changes --- CHANGELOG.md | 61 ++++++++++++++++++++++++++++- README.md | 10 ++--- mix.exs | 2 +- notebooks/exploring_explorer.livemd | 4 +- 4 files changed, 68 insertions(+), 9 deletions(-) diff --git a/CHANGELOG.md b/CHANGELOG.md index 02a298480..1dcd669f4 100644 --- a/CHANGELOG.md +++ b/CHANGELOG.md @@ -7,6 +7,64 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0 ## [Unreleased] +## [v0.10.0] - 2024-10-23 + +### Added + +- Add support for the decimals data type. + + Decimals dtypes are represented by the `{:decimal, precision, scale}` tuple, + where precision can be a positive integer from 0 to 38, and is the maximum number + of digits that can be represented by the decimal. The scale is the number of + digits after the decimal point. + + With this addition, we also added the `:decimal` package as a new dependency. + The `Explorer.Series.from_list/2` function accepts decimal numbers from that + package as values - `%Decimal{}`. + + This version has a small number of operations, but is a good foundation. + +- Allow the usage of queries and lazy series outside callbacks and macros. + This is an improvement to functions that were originally designed to accept callbacks. + With this change you can now reuse lazy series across different "queries". + See the `Explorer.Query` docs for details. + + The affected functions are: + + * `Explorer.DataFrame.filter_with/2` + * `Explorer.DataFrame.mutate_with/2` + * `Explorer.DataFrame.sort_with/2` + * `Explorer.DataFrame.summarise_with/2` + +- Allow accessing the dataframe inside query. + +- Add "lazy read" support for Parquet and NDJSON from HTTP(s). + +- Expose more options for `Explorer.Series.cut/3` and `Explorer.Series.qcut/3`. + These options were available in Polars, but not in our APIs. + +### Fixed + +- Fix creation of series where a `nil` value inside a list - for a `{:list, any()}` dtype - + could result in an incompatible dtype. This fix will prevent panics for list of lists with + `nil` entries. + +- Fix `Explorer.DataFrame.dump_ndjson/2` when date time is in use. + +- Fix `Explorer.Series.product/1` for lazy series. + +- Accept `%FSS.HTTP.Entry{}` structs in functions like `Explorer.DataFrame.from_parquet/2`. + +- Fix encode of binaries to terms from series of the `{:struct, any()}` dtype. + In case the inner fields of the struct had any binary (`:binary` dtype), it was + causing a panic. + +### Changed + +- Change the defaults of the functions `Explorer.Series.cut/3` and `Explorer.Series.qcut/3` + to not have "break points" column in the resultant dataframe. + So the `:include_breaks` is now `false` by default. + ## [v0.9.2] - 2024-08-27 ### Added @@ -1105,7 +1163,8 @@ properly compare floats. First release. -[Unreleased]: https://github.com/elixir-explorer/explorer/compare/v0.9.2...HEAD +[Unreleased]: https://github.com/elixir-explorer/explorer/compare/v0.10.0...HEAD +[v0.10.0]: https://github.com/elixir-explorer/explorer/compare/v0.9.2...v0.10.0 [v0.9.2]: https://github.com/elixir-explorer/explorer/compare/v0.9.1...v0.9.2 [v0.9.1]: https://github.com/elixir-explorer/explorer/compare/v0.9.0...v0.9.1 [v0.9.0]: https://github.com/elixir-explorer/explorer/compare/v0.8.3...v0.9.0 diff --git a/README.md b/README.md index a7ff64064..ee3478ab5 100644 --- a/README.md +++ b/README.md @@ -62,7 +62,7 @@ Inside an Elixir script or [Livebook](https://livebook.dev): ```elixir Mix.install([ - {:explorer, "~> 0.9.0"} + {:explorer, "~> 0.10.0"} ]) ``` @@ -71,7 +71,7 @@ Or in the `mix.exs` file of your application: ```elixir def deps do [ - {:explorer, "~> 0.9.0"} + {:explorer, "~> 0.10.0"} ] end ``` @@ -79,7 +79,7 @@ end Explorer will download a precompiled version of its native code upon installation. You can force a local build by setting the environment variable `EXPLORER_BUILD=1` and including `:rustler` as a dependency: ```elixir - {:explorer, "~> 0.9.0", system_env: %{"EXPLORER_BUILD" => "1"}}, + {:explorer, "~> 0.10.0", system_env: %{"EXPLORER_BUILD" => "1"}}, {:rustler, ">= 0.0.0"} ``` @@ -231,13 +231,13 @@ Rust is going to be installed in the first compilation of the project. Otherwise install the correct version: ```sh -rustup toolchain install nightly-2024-06-24 +rustup toolchain install nightly-2024-07-26 ``` You can also use [asdf](https://asdf-vm.com/): ```sh -asdf install rust nightly-2024-06-24 +asdf install rust nightly-2024-07-26 ``` It's possible that you may need to install [`CMake`](https://cmake.org/) in order to build the project, diff --git a/mix.exs b/mix.exs index af8850333..dd268a9e0 100644 --- a/mix.exs +++ b/mix.exs @@ -2,7 +2,7 @@ defmodule Explorer.MixProject do use Mix.Project @source_url "https://github.com/elixir-nx/explorer" - @version "0.10.0-dev" + @version "0.10.0" @dev? String.ends_with?(@version, "-dev") @force_build? System.get_env("EXPLORER_BUILD") in ["1", "true"] diff --git a/notebooks/exploring_explorer.livemd b/notebooks/exploring_explorer.livemd index 52c1b68e8..b5f935345 100644 --- a/notebooks/exploring_explorer.livemd +++ b/notebooks/exploring_explorer.livemd @@ -4,8 +4,8 @@ ```elixir Mix.install([ - {:explorer, "~> 0.9.0"}, - {:kino, "~> 0.13.0"} + {:explorer, "~> 0.10.0"}, + {:kino, "~> 0.14.0"} ]) ```