[go: nahoru, domu]

Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

parameter "stem-multiplier", "multiplier", "steps" #134

Open
xjhcassy opened this issue Feb 25, 2020 · 5 comments
Open

parameter "stem-multiplier", "multiplier", "steps" #134

xjhcassy opened this issue Feb 25, 2020 · 5 comments

Comments

@xjhcassy
Copy link

Hi, @Catosine, Thanks for sharing the work. I have some quetions about the parameters in model_search.py. I have seen one of your answers in the issues as belows, but I still confused about the parameters "stem-multiplier", "multiplier", "steps", so could you please expland more detail, for example: Have any works found it good in CNN applied to CIFAR/ImageNet. Thank you very much.

I've asked someone who has an research field in automl/nas. He told me that most of the hyperparameters used in DARTS are experience from past, i.e. using stem_mulitiplier=3 is simply because is is found good in previous CNN applied to CIFAR/ImageNet. And that is the same for other hyperparameter you mentioned. He also gives me a suggestion for applying DARTS to other dataset: try to build couple of baselines, and use those hyperparameter as your search space to explore new structures.

@Catosine
Copy link

hi @xjhcassy
just to be quick: i am NOT the author of this work. But I did play with the code for a while.

@Catosine
Copy link

@xjhcassy I also talked to someone in this field: as you have noticed, AutoML is very young and it is not very "auto". i.e. those parameters you mentioned are tuned by human experts.

@Catosine
Copy link

@xjhcassy BTW if you are thinking of applied automl to your own task, then it is a very good idea to start as you mentioned in the blackened words.

@Catosine
Copy link

@xjhcassy In addition, there are following works of DARTS, such as Progressive DARTS, Partial Channel DARTS, FairDARTS. I think they all on github.
Sorry for replying in parts. Good luck:)
PF

@xjhcassy
Copy link
Author

Thank you very much. I take NAS as my graduation design, so recently I am also playing with the code. After reading many of your answers in the issues, it helps me a lot. Thanks again and good luck!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants