Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adding CUTEst.jl to the optimization benchmarks #1036

Merged
merged 173 commits into from
Feb 10, 2025
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
173 commits
Select commit Hold shift + click to select a range
1d9e559
reducing to 32x32
anastasia21112 Sep 23, 2024
e65a86d
plotting spaced out sparsity
anastasia21112 Sep 23, 2024
a4570e0
Changes
ParamThakkar123 Sep 25, 2024
97632f7
Update linear BVP benchmarking
ErikQQY Oct 5, 2024
a6d6519
tweaks
ErikQQY Oct 6, 2024
89e38ae
Add a conclusion
ErikQQY Oct 6, 2024
a6ede33
Add more methods for benchmarking
ErikQQY Oct 6, 2024
8e2fb65
Update compat
ErikQQY Oct 6, 2024
fde4d9d
Setting up CUTEst benchmarks dir structure
alonsoC1s Apr 19, 2024
2eb9776
Unconstrained problem benchmarks
alonsoC1s Apr 21, 2024
81b6f5e
Fixing problem initialization
alonsoC1s Apr 22, 2024
cfae8b4
Starting the analysis
alonsoC1s Aug 23, 2024
c666076
Added preliminary benchmarks for eq/ineq problems with free vars
alonsoC1s Aug 23, 2024
3127b75
ci: install `gfortran` when the CUTEst optimization benchmarks are run
thazhemadam Aug 27, 2024
b9bcf95
fixed variable use in benchmarks
alonsoC1s Aug 27, 2024
343cded
Removing Manifest to fix version errors
alonsoC1s Aug 28, 2024
3b9dc34
Using NLPModels from General Registry
alonsoC1s Sep 3, 2024
c3440bd
revert: "ci: install `gfortran` when the CUTEst optimization benchmar…
thazhemadam Sep 26, 2024
c1df68b
ci: use rootfs image with openmodelica and gfortran pre-installed
thazhemadam Sep 26, 2024
80578c2
Add SciMLBenchmarks to the manifest and the footer
ChrisRackauckas Sep 26, 2024
da91593
split into benchmark groups
ChrisRackauckas Oct 6, 2024
b38c285
CompatHelper: add new compat entry for ODEInterfaceDiffEq at version …
Oct 7, 2024
9bd3be8
CompatHelper: add new compat entry for BenchmarkTools at version 1 fo…
Oct 7, 2024
30e6579
CompatHelper: add new compat entry for OrdinaryDiffEqCore at version …
Oct 7, 2024
dfd556b
CompatHelper: add new compat entry for Plots at version 1 for package…
Oct 7, 2024
eea7d32
CompatHelper: add new compat entry for NaNMath at version 1 for packa…
Oct 7, 2024
b92f213
CompatHelper: add new compat entry for Sundials at version 4 for pack…
Oct 7, 2024
bac8c15
CompatHelper: add new compat entry for LinearSolve at version 2 for p…
Oct 7, 2024
491f0f2
CompatHelper: add new compat entry for LSODA at version 0.7 for packa…
Oct 7, 2024
e309fa1
CompatHelper: add new compat entry for Catalyst at version 14 for pac…
Oct 7, 2024
adf98e1
CompatHelper: add new compat entry for OrdinaryDiffEq at version 6 fo…
Oct 7, 2024
0c7c87a
CompatHelper: add new compat entry for ODEInterface at version 0.5 fo…
Oct 7, 2024
76a584d
CompatHelper: add new compat entry for Symbolics at version 6 for pac…
Oct 7, 2024
57091c5
CompatHelper: add new compat entry for DiffEqDevTools at version 2 fo…
Oct 7, 2024
043e1bd
Merge pull request #1079 from ErikQQY/qqy/bvp_linear
ChrisRackauckas Oct 7, 2024
b420454
Merge pull request #1093 from SciML/compathelper/new_version/2024-10-…
ChrisRackauckas Oct 7, 2024
f520f25
Merge branch 'master' into compathelper/new_version/2024-10-07-00-27-…
ChrisRackauckas Oct 7, 2024
a725892
Merge pull request #1090 from SciML/compathelper/new_version/2024-10-…
ChrisRackauckas Oct 7, 2024
da23034
Merge branch 'master' into compathelper/new_version/2024-10-07-00-27-…
ChrisRackauckas Oct 7, 2024
26eba7e
Merge pull request #1091 from SciML/compathelper/new_version/2024-10-…
ChrisRackauckas Oct 7, 2024
2dd74ef
Merge branch 'master' into compathelper/new_version/2024-10-07-00-27-…
ChrisRackauckas Oct 7, 2024
0efaf3c
Merge pull request #1089 from SciML/compathelper/new_version/2024-10-…
ChrisRackauckas Oct 7, 2024
a968e6d
Merge branch 'master' into compathelper/new_version/2024-10-07-00-27-…
ChrisRackauckas Oct 7, 2024
ecec972
Merge pull request #1088 from SciML/compathelper/new_version/2024-10-…
ChrisRackauckas Oct 7, 2024
554d779
Merge branch 'master' into compathelper/new_version/2024-10-07-00-27-…
ChrisRackauckas Oct 7, 2024
af756cb
Merge pull request #1087 from SciML/compathelper/new_version/2024-10-…
ChrisRackauckas Oct 7, 2024
fec1772
Merge branch 'master' into compathelper/new_version/2024-10-07-00-27-…
ChrisRackauckas Oct 7, 2024
312f48a
Merge pull request #1086 from SciML/compathelper/new_version/2024-10-…
ChrisRackauckas Oct 7, 2024
5f72ce7
Merge branch 'master' into compathelper/new_version/2024-10-07-00-27-…
ChrisRackauckas Oct 7, 2024
a11908f
Merge pull request #1085 from SciML/compathelper/new_version/2024-10-…
ChrisRackauckas Oct 7, 2024
be5f259
Merge branch 'master' into compathelper/new_version/2024-10-07-00-27-…
ChrisRackauckas Oct 7, 2024
2a9dcd8
Merge pull request #1082 from SciML/compathelper/new_version/2024-10-…
ChrisRackauckas Oct 7, 2024
d3440a4
Merge branch 'master' into compathelper/new_version/2024-10-07-00-27-…
ChrisRackauckas Oct 7, 2024
2639f13
Merge pull request #1084 from SciML/compathelper/new_version/2024-10-…
ChrisRackauckas Oct 7, 2024
feeb5bc
Merge branch 'master' into compathelper/new_version/2024-10-07-00-27-…
ChrisRackauckas Oct 7, 2024
06c4f72
Merge pull request #1083 from SciML/compathelper/new_version/2024-10-…
ChrisRackauckas Oct 7, 2024
2377085
Merge branch 'master' into compathelper/new_version/2024-10-07-00-27-…
ChrisRackauckas Oct 7, 2024
56e9ead
Merge pull request #1081 from SciML/compathelper/new_version/2024-10-…
ChrisRackauckas Oct 7, 2024
338d6ea
Merge branch 'master' into compathelper/new_version/2024-10-07-00-27-…
ChrisRackauckas Oct 7, 2024
ea6a984
Merge pull request #1092 from SciML/compathelper/new_version/2024-10-…
ChrisRackauckas Oct 7, 2024
efa61e3
Update CUTEst_bounded.jmd
ChrisRackauckas Oct 7, 2024
d94b888
fixing plot bug
anastasia21112 Oct 10, 2024
f3294de
bug fixing
anastasia21112 Oct 11, 2024
2b592d0
Merge branch 'master' of https://github.com/SciML/SciMLBenchmarks.jl …
ParamThakkar123 Oct 14, 2024
dfedece
Updates
ParamThakkar123 Oct 14, 2024
4266e63
Merge branch 'master' of https://github.com/SciML/SciMLBenchmarks.jl
ParamThakkar123 Oct 14, 2024
b926a2d
Added Updates for BayesianInference
ParamThakkar123 Oct 14, 2024
cf3667f
changes
ParamThakkar123 Oct 15, 2024
ef4dadf
Changes
ParamThakkar123 Oct 15, 2024
0c2dbfc
Updates
ParamThakkar123 Oct 15, 2024
143f091
Remove unsuccessful solvings in linear BVP benchmarks
ErikQQY Oct 15, 2024
1e4aaee
Added Updates for BayesianInference
ParamThakkar123 Oct 14, 2024
29110a4
Updates
ParamThakkar123 Oct 15, 2024
0b62dce
Merge branch 'BayesianInference' of https://github.com/ParamThakkar12…
ParamThakkar123 Oct 15, 2024
7be8b4a
Fixes
ParamThakkar123 Oct 15, 2024
fb171fc
updates
ParamThakkar123 Oct 15, 2024
da91eaa
use the latest DiffEqDevTools
ErikQQY Oct 16, 2024
986184c
Add more solvers
ErikQQY Oct 16, 2024
435b05e
Merge pull request #1097 from ErikQQY/qqy/ensure_success_solve
ChrisRackauckas Oct 16, 2024
2288628
Updates
ParamThakkar123 Oct 18, 2024
61c475f
Updates
ParamThakkar123 Oct 18, 2024
cd7aae2
Updates
ParamThakkar123 Oct 18, 2024
a146fdb
Changes Made
ParamThakkar123 Oct 19, 2024
5535ed2
Updates
ParamThakkar123 Oct 19, 2024
1480575
Merge pull request #1067 from ParamThakkar123/DynamicalODE
ChrisRackauckas Oct 19, 2024
30e6572
CompatHelper: bump compat for Plots to 1 for package DynamicalODE, (k…
Oct 20, 2024
43bb152
Merge pull request #1100 from SciML/compathelper/new_version/2024-10-…
ChrisRackauckas Oct 20, 2024
570c819
Updates
ParamThakkar123 Oct 20, 2024
476fe38
Merge pull request #1096 from ParamThakkar123/BayesianInference
ChrisRackauckas Oct 21, 2024
b907904
Revert "Bayesian inference"
ChrisRackauckas Oct 21, 2024
5810a21
Merge pull request #1101 from SciML/revert-1096-BayesianInference
ChrisRackauckas Oct 21, 2024
c07479d
CompatHelper: bump compat for NonlinearSolve to 4 for package Complic…
Nov 4, 2024
2b5298a
CompatHelper: bump compat for NonlinearSolve to 4 for package Interva…
Nov 4, 2024
4645774
CompatHelper: bump compat for NonlinearSolve to 4 for package Nonline…
Nov 4, 2024
dd5e344
CompatHelper: bump compat for SimpleNonlinearSolve to 2 for package N…
Nov 4, 2024
f721f1e
Merge pull request #1111 from SciML/compathelper/new_version/2024-11-…
ChrisRackauckas Nov 7, 2024
052b850
Merge pull request #1112 from SciML/compathelper/new_version/2024-11-…
ChrisRackauckas Nov 7, 2024
b93bcd8
Merge pull request #1113 from SciML/compathelper/new_version/2024-11-…
ChrisRackauckas Nov 7, 2024
8a02b81
Merge pull request #1114 from SciML/compathelper/new_version/2024-11-…
ChrisRackauckas Nov 7, 2024
8b0316d
feat: update to nonlinear solve v4
avik-pal Nov 4, 2024
607e73d
fix: update quadratic solving
avik-pal Nov 7, 2024
c8cb9fe
chore: update nonlinear battery problem
avik-pal Nov 8, 2024
40cce8b
bump Manifest/Project
vyudu Nov 8, 2024
7528a58
up
vyudu Nov 8, 2024
7044715
Revert DynamicalODE
ChrisRackauckas Nov 9, 2024
e81a18e
Merge pull request #1119 from SciML/dynamical_revert
ChrisRackauckas Nov 9, 2024
d6c21a4
bump manifest
vyudu Nov 9, 2024
2b8fa0a
Updated the nelson ODE function, (made it nicer to look at) and added…
nnd389 Oct 25, 2024
17c3c55
Updated the nelson ODE function, (made it nicer to look at) and added…
nnd389 Oct 25, 2024
f4ab044
Update nelson.jmd
ChrisRackauckas Oct 25, 2024
238089b
bump astrochem manifest
ChrisRackauckas Oct 27, 2024
08882e5
update manifest
ChrisRackauckas Oct 28, 2024
8d5e757
typo
oscardssmith Oct 28, 2024
1525c77
bump manifest
ChrisRackauckas Nov 10, 2024
4f741fd
bump OrdinaryDiffEqDifferentiation
ChrisRackauckas Nov 11, 2024
f64834b
more bump
ChrisRackauckas Nov 11, 2024
e7ab6c5
final bump?
ChrisRackauckas Nov 11, 2024
77aae93
chore: update the last benchmarks
avik-pal Nov 11, 2024
5082383
simplify a bit
ChrisRackauckas Nov 12, 2024
5eda15c
Update benchmarks/AstroChem/astrochem.jmd
ChrisRackauckas Nov 13, 2024
efbedc9
Update nelson.jmd
ChrisRackauckas Nov 13, 2024
3247b07
Update Mendes_multistate_example.jmd
ChrisRackauckas Nov 13, 2024
6d1db03
simplify a bit
ChrisRackauckas Nov 14, 2024
a12642c
Merge pull request #1118 from vyudu/bump-from-master
ChrisRackauckas Nov 14, 2024
db7f53f
Update benchmarks/AstroChem/astrochem.jmd
ChrisRackauckas Nov 14, 2024
29517b9
Update nelson.jmd
ChrisRackauckas Nov 14, 2024
a5b20e3
CompatHelper: add new compat entry for ReactionNetworkImporters at ve…
Nov 15, 2024
449e591
Merge pull request #1124 from SciML/compathelper/new_version/2024-11-…
ChrisRackauckas Nov 15, 2024
bf4f81c
Update nelson.jmd
ChrisRackauckas Nov 15, 2024
d290772
Update benchmarks/AstroChem/astrochem.jmd
ChrisRackauckas Nov 15, 2024
eac29be
Merge pull request #1110 from SciML/astrochem2
ChrisRackauckas Nov 16, 2024
7016ad1
Bump Bio for Catalyst v14 and MTK v9
ChrisRackauckas Jul 28, 2024
87a26f9
complete all
ChrisRackauckas Jul 28, 2024
ffb64af
complete converted sys and get u0 and p from oprob
isaacsas Aug 12, 2024
4fecc66
manifest bump
ChrisRackauckas Sep 11, 2024
f49e30f
remove broken and unnecessary plot limit calculation
ChrisRackauckas Sep 14, 2024
b497130
Manifest
ChrisRackauckas Nov 8, 2024
b71e60b
lts
ChrisRackauckas Nov 9, 2024
b2bd2f1
bumps
ChrisRackauckas Nov 11, 2024
e1a5758
should fix the polyesterthreads issue
ChrisRackauckas Nov 17, 2024
8bf5f73
testing percentage away from banded matrix
anastasia21112 Nov 19, 2024
bfd62df
Merge remote-tracking branch 'origin/master' into banded-mtx
anastasia21112 Nov 19, 2024
c82f9f5
Merge pull request #1022 from SciML/biobump
ChrisRackauckas Nov 19, 2024
aaa448c
Just don't show the reaction network parts
ChrisRackauckas Nov 19, 2024
53c3bd2
Merge pull request #1129 from SciML/ChrisRackauckas-patch-2
ChrisRackauckas Nov 19, 2024
7cdd89b
fixing errors
anastasia21112 Nov 20, 2024
4892d14
Merge remote-tracking branch 'origin/master' into spaced-out-sparsity
anastasia21112 Nov 20, 2024
7df345c
Merge pull request #1116 from SciML/ap/nonlinearsolve4
ChrisRackauckas Nov 20, 2024
2793354
CompatHelper: add new compat entry for DifferentiationInterface at ve…
Nov 21, 2024
1c14fdd
CompatHelper: add new compat entry for PETSc at version 0.3 for packa…
Nov 21, 2024
1309f84
CompatHelper: add new compat entry for SparseConnectivityTracer at ve…
Nov 21, 2024
a9a112c
CompatHelper: add new compat entry for LineSearches at version 7 for …
Nov 21, 2024
80660b4
CompatHelper: add new compat entry for Enzyme at version 0.13 for pac…
Nov 21, 2024
1b94201
Merge pull request #1131 from SciML/compathelper/new_version/2024-11-…
ChrisRackauckas Nov 21, 2024
e4436c9
Merge pull request #1132 from SciML/compathelper/new_version/2024-11-…
ChrisRackauckas Nov 21, 2024
4d0ded3
Merge pull request #1133 from SciML/compathelper/new_version/2024-11-…
ChrisRackauckas Nov 21, 2024
349c6db
Merge pull request #1134 from SciML/compathelper/new_version/2024-11-…
ChrisRackauckas Nov 21, 2024
6956d74
Merge branch 'master' into compathelper/new_version/2024-11-21-00-38-…
ChrisRackauckas Nov 21, 2024
1f04bd9
Merge pull request #1135 from SciML/compathelper/new_version/2024-11-…
ChrisRackauckas Nov 21, 2024
bf39232
fixing graphs
anastasia21112 Nov 23, 2024
9d9c2e3
testing with a smaller subset
anastasia21112 Nov 26, 2024
1d4cf3c
running for all matrices
anastasia21112 Nov 26, 2024
655c211
merging spaced-out-sparsity
anastasia21112 Nov 28, 2024
8eba943
plotting bandedness for 5, 10, 20
anastasia21112 Nov 28, 2024
ccfef91
Merge pull request #1066 from anastasia21112/spaced-out-sparsity
ChrisRackauckas Nov 30, 2024
6886332
Merge pull request #1128 from anastasia21112/banded-mtx
ChrisRackauckas Nov 30, 2024
c7b744b
Add ionic liquid dehumidifier benchmarks
ErikQQY Nov 18, 2024
5680920
Put ionic liquid humidifier in the right folder
ErikQQY Nov 18, 2024
dd73eb6
fully revert non-stiff changes
ChrisRackauckas Dec 3, 2024
b31635b
add new benchmark section
ChrisRackauckas Dec 3, 2024
6864e55
Merge pull request #1127 from ErikQQY/qqy/ionic
ChrisRackauckas Dec 3, 2024
0d44597
Merge remote-tracking branch 'alonsoC1s/master'
ChrisRackauckas Feb 10, 2025
75b550a
Bump LinearSolves
ChrisRackauckas Feb 10, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 3 additions & 2 deletions .buildkite/launch_benchmarks.yml.signature
Original file line number Diff line number Diff line change
@@ -1,2 +1,3 @@
Salted__�c?�ު��DwL�J�/���)��|p��5 +c��\~o�.�� RR�hAZR��
$'���� 6���!�m�^����S�j�Y�����
Salted__�c?
�ު��DwL�J�/���)��|p��5 +c��\~o�.�� RR�hAZR��
$'���� 6���!�m�^����S�j�Y�����
4 changes: 2 additions & 2 deletions .buildkite/run_benchmark.yml
Original file line number Diff line number Diff line change
Expand Up @@ -19,8 +19,8 @@ steps:
- JuliaCI/julia#v1:
version: "1.10"
- staticfloat/sandbox:
rootfs_url: "https://github.com/thazhemadam/openmodelica-rootfs-image/releases/download/v1.23.0/rootfs-openmodelica-v1.23.0.amd64.tar.gz"
rootfs_treehash: "82970243dc4f188e599a976abc20951f4aba2912"
rootfs_url: "https://github.com/thazhemadam/ScimlBenchmarks-rootfs-image/releases/download/rootfs-image/rootfs-script.amd64.tar.gz"
rootfs_treehash: "943bde824554f0afad5a939341f05e3bdb393051"
uid: 1000
gid: 1000
workspaces:
Expand Down
575 changes: 362 additions & 213 deletions benchmarks/AstroChem/Manifest.toml

Large diffs are not rendered by default.

17 changes: 17 additions & 0 deletions benchmarks/AstroChem/Project.toml
Original file line number Diff line number Diff line change
Expand Up @@ -10,5 +10,22 @@ ODEInterfaceDiffEq = "09606e27-ecf5-54fc-bb29-004bd9f985bf"
OrdinaryDiffEq = "1dea7af3-3e70-54e6-95c3-0bf5283fa5ed"
OrdinaryDiffEqCore = "bbf590c4-e513-4bbe-9b18-05decba2e5d8"
Plots = "91a5bcdd-55d7-5caf-9e0b-520d859cae80"
RecursiveFactorization = "f2c3362d-daeb-58d1-803e-2bc74f2840b4"
Sundials = "c3572dad-4567-51f8-b174-8c6c989267f4"
Symbolics = "0c5d862f-8b57-4792-8d23-62f2024744c7"

[compat]
BenchmarkTools = "1"
Catalyst = "14"
DiffEqDevTools = "2"
LSODA = "0.7"
LinearSolve = "3"
NaNMath = "1"
ODEInterface = "0.5"
ODEInterfaceDiffEq = "3"
OrdinaryDiffEq = "6.89"
OrdinaryDiffEqCore = "1.9"
Plots = "1"
RecursiveFactorization = "0.2.23"
Sundials = "4"
Symbolics = "6"
9 changes: 3 additions & 6 deletions benchmarks/AstroChem/astrochem.jmd
Original file line number Diff line number Diff line change
Expand Up @@ -10,6 +10,7 @@ using Plots
using Symbolics
using DiffEqDevTools
using Sundials, ODEInterface, ODEInterfaceDiffEq, LSODA
using RecursiveFactorization
```

## Without Temperature Dynamics
Expand Down Expand Up @@ -383,8 +384,6 @@ refsol = solve(oprob, Rodas5P(), abstol=1e-14, reltol=1e-14)
```julia
refsol = solve(oprob, Rodas5P(), abstol=1e-13, reltol=1e-13)

solve(oprob, RadauIIA9(), abstol=1e-9, reltol=1e-9)

# Run Benchmark

abstols = 1.0 ./ 10.0 .^ (9:10)
Expand All @@ -393,17 +392,15 @@ reltols = 1.0 ./ 10.0 .^ (9:10)
setups = [
Dict(:alg=>FBDF()),
Dict(:alg=>QNDF()),
#Dict(:alg=>Rodas4P()),
Dict(:alg=>CVODE_BDF()),
#Dict(:alg=>ddebdf()),
#Dict(:alg=>Rodas4()),
Dict(:alg=>Rodas5P()),
Dict(:alg=>KenCarp4()),
Dict(:alg=>KenCarp47()),
Dict(:alg=>RadauIIA9()),
#Dict(:alg=>RadauIIA9()),
#Dict(:alg=>rodas()),
#Dict(:alg=>radau()),
#Dict(:alg=>lsoda()),
Dict(:alg=>lsoda()),
#Dict(:alg=>ImplicitEulerExtrapolation(min_order = 5, init_order = 3,threading = OrdinaryDiffEqCore.PolyesterThreads())),
#Dict(:alg=>ImplicitEulerExtrapolation(min_order = 5, init_order = 3,threading = false)),
#Dict(:alg=>ImplicitEulerBarycentricExtrapolation(min_order = 5, threading = OrdinaryDiffEqCore.PolyesterThreads())),
Expand Down
Loading