Reviews from AWS Marketplace
0 AWS reviews
-
5 star0
-
4 star0
-
3 star0
-
2 star0
-
1 star0
External reviews
External reviews are not included in the AWS star rating for the product.
Great platform - saves me many hours of work for tasks that I've previously coded manually
What do you like best about the product?
Easy to use, already incorported into major libraries, but still powerful.
What do you dislike about the product?
The only thing I wish was different is pricing per "tracked hour". For my workflow, this number seems very inflated - I have a few powerful GPUs, and run multiple experiments at a time on each one. This results in "tracked hours" of many multiples of realtime, for each GPU, which doesn't seem right. This is OK for me now as an academic, on the personal plan with unlimited tracked hours, but discourages me from using this for commercial projects in the future, where cost would quickly become prohibitive.
What problems is the product solving and how is that benefiting you?
Experiment tracking is hard, important, and wandb makes it almost trivial.
- Leave a Comment |
- Mark review as helpful
Weights & Biases
What do you like best about the product?
Much easier than tensorboard. Way easier to get started and then a lot more functionality once you're more experienced.
Easy monitoring of gpu use.
Very easy to compare runs.
Easy to upload tables and images.
Also easy to compare just the runs you want and to save working experiments in a nice format (reports)
Easy monitoring of gpu use.
Very easy to compare runs.
Easy to upload tables and images.
Also easy to compare just the runs you want and to save working experiments in a nice format (reports)
What do you dislike about the product?
The only downsides which I hope will be fixed at some point is you don't have an easy way of deleting just one run.
Would be nice if you could restart a run from the step you left it at as well.
But in the day to day use they're pretty minor and the positives outweigh the downsides.
Would be nice if you could restart a run from the step you left it at as well.
But in the day to day use they're pretty minor and the positives outweigh the downsides.
What problems is the product solving and how is that benefiting you?
I'm a researcher not a business so it's mainly helping me keep track of my research.
I like the ease of setup, I know no viable alternative, I hate the slowness and numerous bugs
What do you like best about the product?
It is easy, I can live preview the results, all the plots are done automatically and smartly. It is a great gain of time.
What do you dislike about the product?
The user interface is slow but it is acceptable. Retrieving runs data from wandb using the wandb.Api() takes forever (e.g., 30h for around 30 000 runs of hyperparameter in several environments). I would like to be able to download all data from a set of runs selected from filters in a single api call. Since it represents less than 100 mb of data, it should be feasible in a few minutes maximum, right? The documentation is not great.
What problems is the product solving and how is that benefiting you?
Logging and visualization during development (since I am using wandb in research, I still have to redownload all data using wanbd.Api() at the end, because the wandb plot are not professional enough (bitmap instead of vectors)).
It is saving me a enormous amount of time.
It is saving me a enormous amount of time.
Easy-to-setup model logging product
What do you like best about the product?
It is very quick to get started with logging models and performance to wandb, implementation and integration are readily intuitive and straightforward.
There are some useful available features such as model sweeping and other filtering/grouping mechanisms with runs logged in a given project.
Whenever I need to keep track of ML model performance, I use wandb.
There are some useful available features such as model sweeping and other filtering/grouping mechanisms with runs logged in a given project.
Whenever I need to keep track of ML model performance, I use wandb.
What do you dislike about the product?
The number of concurrent runs is somehow too limited if one launches jobs to a cluster.
It is most of the time hard to find the relevant information you are seeking for in the documentation, hence help comes from issues dealt online by users on different platforms (github, stackoverflow, etc.)
It is most of the time hard to find the relevant information you are seeking for in the documentation, hence help comes from issues dealt online by users on different platforms (github, stackoverflow, etc.)
What problems is the product solving and how is that benefiting you?
- Logging performance of machine learning models
- Helping the optimization of model hyperparameters
It represents a large gain of time compared to manual logging and optimization.
- Helping the optimization of model hyperparameters
It represents a large gain of time compared to manual logging and optimization.
great tool for tracking experiments
What do you like best about the product?
i use it as my single point of knowledge for all my experiments results, including model weights, configs, false analysis etc
What do you dislike about the product?
many specific use cases, which are not that specific imo, i had to implement myself,
What problems is the product solving and how is that benefiting you?
easy experiment tracking
W&B helped me increase my productivity
What do you like best about the product?
I like the WEB UI, especially the manipulation of plots and reports as they simplify and visualize many metrics and parameters.
I also like the artifactory and the model registry, they help manage the countless number of models created during an ML/DL project.
Sweep management is also cool! We build an automation tool around it that simplifies ML sweeps and thus helps us get better results.
Finally, I love the prompt and kind assistance we (Nvidia) get on the dedicated Slack channel. Really appreciated!
I also like the artifactory and the model registry, they help manage the countless number of models created during an ML/DL project.
Sweep management is also cool! We build an automation tool around it that simplifies ML sweeps and thus helps us get better results.
Finally, I love the prompt and kind assistance we (Nvidia) get on the dedicated Slack channel. Really appreciated!
What do you dislike about the product?
Not too much actually :)
I guess sometimes the web UI is a bit slow.
I guess sometimes the web UI is a bit slow.
What problems is the product solving and how is that benefiting you?
It solves the management of many (many many) ML experiments; helps us improve our KPIs and track this improvement.
This is benefiting us by saving a lot of time on taking dev decisions based on results (i.e., decide on some algo change, set of hyper parameters).
This is benefiting us by saving a lot of time on taking dev decisions based on results (i.e., decide on some algo change, set of hyper parameters).
Best existing machine learning experiment tracker, including a great hyperparameter tuning
What do you like best about the product?
Extremely easy to use (both in browser or via API) + sweep launcher that allows to distributes experiments for different machines
What do you dislike about the product?
There's no easy pipeline for cross-validation, unless you play a bit around... In any case, it does never get as smooth as the other default functionalities
It is designed for the setting where you have fixed train, val, test sets
It is designed for the setting where you have fixed train, val, test sets
What problems is the product solving and how is that benefiting you?
- Experiment tracker
- Hyperparameter tuning (Sweep)
Wandb makes integration of both aspects above quite easy in machine learning experiments
- Hyperparameter tuning (Sweep)
Wandb makes integration of both aspects above quite easy in machine learning experiments
Great product -- too expensive
What do you like best about the product?
graphs, experiment logs, easy to share within team
What do you dislike about the product?
too expensive. latency sometimes sucks too.
What problems is the product solving and how is that benefiting you?
experiment tracking
Best for data science and NLP tasks
What do you like best about the product?
Used Weight & Biases for Natural language processing task where i have to train pre-trained models like Bert and RoBerta for classification models. By using Weight & Biases i don't have to manage the weights, loss and accuracy charts. All i have to login and initilize. You can login with your github account.
What do you dislike about the product?
Honestly nothing, only i think confusion part by viewing different analytics charts get valuable information. Default names mention are also little bit long and confusing.
What problems is the product solving and how is that benefiting you?
I makes life easier because you don't have to manage weights for model training and all data automatically saved in directory, which can be accessed any time you want by simply login to platform. And its free.
A great tool for ML
What do you like best about the product?
W&B is an excellent tool, particularly for collaborating on and maintaining a record of machine learning experiments. I think its role is in closing the gap between training and analysis, which it does very well.
What do you dislike about the product?
* Reports performance can be slow at times for a large number of displayed runs (e.g. 300-600)
* Tools such as Sweeps don't allow for an alternative backend, and available frontend tools are somewhat clunky without specific customization towards the end use (e.g. using reports for analyzing tune results). As it exists now, I think W&B offers more to ML teams that don't have a supporting SW infrastructure team.
* Tools such as Sweeps don't allow for an alternative backend, and available frontend tools are somewhat clunky without specific customization towards the end use (e.g. using reports for analyzing tune results). As it exists now, I think W&B offers more to ML teams that don't have a supporting SW infrastructure team.
What problems is the product solving and how is that benefiting you?
* Experiment tracking
* Quickly performing basic analysis early on in experiments
* Quickly performing basic analysis early on in experiments
showing 1 - 10