Hi,
From what I understand here https://dashboard.alphien.com/competitions/alphathon/UBSHACKATHON, the submission deadline to earn the first points is 27th Sep. Can I post my submission earlier to check the results? But does this mean I only have 1 more submission left for the entire duration of the competition? Can I remove or revise my submitted notebooks?
You can of course submit your model earlier than the deadline. Your model will be reviewed right after the submission. If the model meets all the requirements, it will be part of the leader board and ranked among all the models from the other team.
You will be able to revise your model throughout the entire first round.
As a followup, I read somewhere that we only get two submissions in the competition.
Is this correct? Your response indicates to me that we can make unlimited submissions to the leaderboard?
Thanks
Hi,
You can submit only two different models in total per competition. However, you can fine tune (change hyper parameters for instance) these two submitted models many times.
Check the “submissions” section here: Alphien Dashboard
Thank you for the quick reply Herve!
Is there any measure on how extensive these changes can be? You say fine tuning hyper-params as an example, but the link just says we can submit two distinct notebooks that can be revised as many times as we like.
e.g. if I submitted two notebooks and in one of them I implement some strategy A and later change to a completely different strategy B (or a significantly altered version of A) within the same notebook, is that still okay? Or does that count as a new strategy - if so how can you monitor that?
Thank you
If the submission gets substantially altered, such as in your example where the underlying model is completely changed, this wouldn’t qualify for a revision. Our quant team will test all submissions to make sure they are sound and can be replicated for future trading, so we will see the first version of any submission. If the model deviate substantially from one version to another, we’ll not consider it a revision but a new submission. If you have no other submission left (already topped at 2), we’ll disregard the latest change and use prior version.
Hope this clarifies it.
Okay that makes sense, thank you!
Hi Herve,
Can I just clarify one last thing actually - is this max two submissions at once or two submissions across all time?
e.g. If I have submitted two notebooks, can I revoke one of them so that I can enter a completely new one? or can I only ever make two notebook submissions?
If it’s the latter, that seems quite tricky to try and plan strategies in advance and commit to them. I would have thought there would be scope for us to resubmit our “top 2 strats” when we like. What if I discover a great strategy in the final week, but already submitted twice - can I not use it, or am I able to delete an old one?
Thanks
Hi,
I understand your question. However, putting a limit that can be lifted by revoking and creating a new submission is no longer a limit. On top of this, it would introduce a selection bias.
At the end of the day, this is the name of the game, it’s a competition: you have to balance the trade-off between submitting early to potentially earn points while other teams still haven’t submitted (higher chance to get points) but committing to this submission by using 1 submission out of 2, and only refine it over the following weeks. This is a strategic choice you need to make with your team.
Remember the goal of the first round is to access the second round! If you submit no solution and you find an excellent strategy the day before the first round closes, there could be a chance that you don’t get through if other teams have accumulated more points through previous weeks. It would be a mistake to not submit early at least one strategy to keep this option.
Have a look at Alphien Dashboard Selection Criteria to balance out possible scenarios and pick the best strategic approach.
Please let us know if you have further questions or if all clear. Thanks again for your questions
That makes sense - I just wanted to make sure I understood it correctly. I will keep that in mind, thank you Herve!