Before logging an issue, please update to the latest release of Visual Micro from the Downloads Page.

When Logging a Support Issue in the Forum, please ensure you have also:-

  • Enabled vMicro > Compiler > Show Build Properties
  • Re-Compile your program with these settings enabled
 
Save the new Output to a Text File and....
  • Click the Reply button and attach as .txt file OR
  • Click here to Email us with the file attached, and a link to your post
Support requests without the output above may be impossible to answer, so please help us to help you
 
Page Index Toggle Pages: 1 Send TopicPrint
Hot Topic (More than 8 Replies) failure to compile using SCons (Read 2953 times)
ludo
Junior Member
**
Offline


Posts: 10
Joined: Oct 23rd, 2023
failure to compile using SCons
Jul 12th, 2024 at 2:33am
Print Post  
Hi,

trying the new Deep Search +SCons to speed up my (painfully) slow compile time. Compile was working with previous version (just deep search) and is working with Gcc-E.

Unfortunately I get an error "Illegal characters in path" and the compile fails with SCons. I have changed my temp path to d:/temp to try and solve the problem to no avail.

I attach the log with SCons (failure) and the successful one with Gcc-E. Thanks for any help as I really wish to decrease compile time using SCons.

Best regards
« Last Edit: Jul 12th, 2024 at 2:34am by ludo »  

Please Register or Login to the Forum to see File Attachments
Back to top
 
IP Logged
 
Simon@Visual Micro
Administrator
*****
Offline


Posts: 2695
Joined: Feb 13th, 2019
Re: failure to compile using SCons
Reply #1 - Jul 12th, 2024 at 6:17am
Print Post  
Thanks for the report, we will look into the cause of the issue, could you attach or email the "BuildFolder\.vmpreproc\SConsIncludePaths.txt" file for us to review?

Can you confirm the Gcc-E Deep Search Caching is working as expected for you, so performing a second build with Gcc-E is much quicker?
(Note: this is without changing to the Scons option in between the Gcc-E Builds)
« Last Edit: Jul 12th, 2024 at 6:50am by Simon@Visual Micro »  
Back to top
IP Logged
 
ludo
Junior Member
**
Offline


Posts: 10
Joined: Oct 23rd, 2023
Re: failure to compile using SCons
Reply #2 - Jul 12th, 2024 at 4:09pm
Print Post  
Hi,

using Gcc-E deep search with slight modification of prog between build (just a number for a condition), no change to lib or their calls:
-first compile: 6min47sec
-second compile: 3min20

Even with caching in Gcc-E, this is still slow and I'd really like to be able to use SCons

BR
  
Back to top
 
IP Logged
 
Simon@Visual Micro
Administrator
*****
Offline


Posts: 2695
Joined: Feb 13th, 2019
Re: failure to compile using SCons
Reply #3 - Jul 12th, 2024 at 4:37pm
Print Post  
Thanks for the update and clarification.

Is there a file in the "D:/temp/VMBuilds/version_1/esp32_d32/Release/.vmpreproc/SConsIncludePaths.txt"?

If that is present please attach it as it may help us to understand where the original error is coming from regarding Illegal Characters.
« Last Edit: Jul 12th, 2024 at 4:37pm by Simon@Visual Micro »  
Back to top
IP Logged
 
ludo
Junior Member
**
Offline


Posts: 10
Joined: Oct 23rd, 2023
Re: failure to compile using SCons
Reply #4 - Jul 12th, 2024 at 9:20pm
Print Post  
Hi,

no file named SConsIncludePaths.txt but one named includes_paths.txt

Cheers
Ludo

PS: not sure, but some of the lines in includes_paths.txt look very long. They all start with (split lilines so I can paste)
c:\Users\Ludo\AppData\Local
\Arduino15\packages\esp32\hardware\esp32\2.0.11\
and then cores, variants or libraries

moving them to a shorter path may do the trick. If you think this is worth a shot, please advice on how to do so
« Last Edit: Jul 12th, 2024 at 9:39pm by ludo »  

Please Register or Login to the Forum to see File Attachments
Back to top
 
IP Logged
 
Simon@Visual Micro
Administrator
*****
Offline


Posts: 2695
Joined: Feb 13th, 2019
Re: failure to compile using SCons
Reply #5 - Jul 15th, 2024 at 10:12am
Print Post  
Thanks for the update and detail.

The paths are only around 100 chars so this should be a long way away from any long path limits.

Could you run the attached commands via the command line, and attach the file created D:/_WIP/arduino/libraries/AllLibraryFiles.txt ?
  

Please Register or Login to the Forum to see File Attachments
Back to top
IP Logged
 
ludo
Junior Member
**
Offline


Posts: 10
Joined: Oct 23rd, 2023
Re: failure to compile using SCons
Reply #6 - Jul 15th, 2024 at 12:39pm
Print Post  
Hi, 

for some reasons, the option to attach files has dissapeared when I hit reply or when I try to use personal mail in the forum interface. How can I email the file to you?

Cheers

PS: last file I attached, it had already been a struggle and the option to attach can up randomly
« Last Edit: Jul 15th, 2024 at 12:41pm by ludo »  
Back to top
 
IP Logged
 
Simon@Visual Micro
Administrator
*****
Offline


Posts: 2695
Joined: Feb 13th, 2019
Re: failure to compile using SCons
Reply #7 - Jul 15th, 2024 at 1:06pm
Print Post  
If you email it to info[at]visualmicro.com with a link to this post we will receive it.
  
Back to top
IP Logged
 
Simon@Visual Micro
Administrator
*****
Offline


Posts: 2695
Joined: Feb 13th, 2019
Re: failure to compile using SCons
Reply #8 - Jul 15th, 2024 at 3:17pm
Print Post  
Also please try the very latest version (2024.0715.0) available from the top of the below board, with the Gcc-E Deep Search Option as the caching should be improved further for the second build:
https://www.visualmicro.com/forums/YaBB.pl?board=VS_ARDUINO_EXT_RELEASES
  
Back to top
IP Logged
 
ludo
Junior Member
**
Offline


Posts: 10
Joined: Oct 23rd, 2023
Re: failure to compile using SCons
Reply #9 - Jul 15th, 2024 at 4:46pm
Print Post  
Hi,

already send the dir cat file by email.

Before update to latest version for Gcc caching improvement
-first compile: 6min47sec = 407 sec
-second compile: 3min20 = 200 sec = 51% faster

Tried the new version Gcc:
- 1st compile: 7min25sec = 445 sec
-2nd compile: 3min18sec = 198 sec = 56% faster, but with first compile slower

So maybe a slight improvement with the new version of visual studio, but not obvious.

Please let me know once you reviewed the dircat, could not spot anything obvious.

Thanks in advance
BR
  
Back to top
 
IP Logged
 
Simon@Visual Micro
Administrator
*****
Offline


Posts: 2695
Joined: Feb 13th, 2019
Re: failure to compile using SCons
Reply #10 - Jul 15th, 2024 at 5:11pm
Print Post  
Thanks for the update, and for the directory listing.

We can't see anything obvious at present and will keep looking for the root cause of the issue.
  
Back to top
IP Logged
 
ludo
Junior Member
**
Offline


Posts: 10
Joined: Oct 23rd, 2023
Re: failure to compile using SCons
Reply #11 - Jul 15th, 2024 at 6:31pm
Print Post  
Hi,

Would really appreciate a solution for SCons as with Gcc compiling times make programming very painful.

Cheers
  
Back to top
 
IP Logged
 
Simon@Visual Micro
Administrator
*****
Offline


Posts: 2695
Joined: Feb 13th, 2019
Re: failure to compile using SCons
Reply #12 - Jul 17th, 2024 at 7:45pm
Print Post  
We have added more error logging so we can see more accurately where this could be failing to the latest version (2024.0717.0) which can be downloaded from the top of the below board:
https://www.visualmicro.com/forums/YaBB.pl?board=VS_ARDUINO_EXT_RELEASES

If you could install this, and retry compliling with SCons, and attach the output it should allow us to identify what path/s could be the cause of the issue.
  
Back to top
IP Logged
 
ludo
Junior Member
**
Offline


Posts: 10
Joined: Oct 23rd, 2023
Re: failure to compile using SCons
Reply #13 - Jul 17th, 2024 at 11:13pm
Print Post  
Hi,

thanks for following up. New log attached.

BR
  

Please Register or Login to the Forum to see File Attachments
Back to top
 
IP Logged
 
Simon@Visual Micro
Administrator
*****
Offline


Posts: 2695
Joined: Feb 13th, 2019
Re: failure to compile using SCons
Reply #14 - Jul 18th, 2024 at 5:38pm
Print Post  
Then latest version (2024.0719.0) can be downloaded from the top of the below board:
https://www.visualmicro.com/forums/YaBB.pl?board=VS_ARDUINO_EXT_RELEASES

This has major improvements to the Gcc-E caching which should mean any changes to the project code do not affect Deep Search (unless changes to defines/includes), meaning your compile time should be vastly reduced compared to before.

There is also further error trapping for Scons, which may not be needed with the above improvements.

Does the same issue happen on a new project on your machine with the SCons Deep Search enabled?
« Last Edit: Jul 19th, 2024 at 8:17am by Simon@Visual Micro »  
Back to top
IP Logged
 
ludo
Junior Member
**
Offline


Posts: 10
Joined: Oct 23rd, 2023
Re: failure to compile using SCons
Reply #15 - Jul 19th, 2024 at 9:43pm
Print Post  
Hi,

I have tried with the latest version as advised in your email (2024.0718.0).

Please see log attached. As I couldn't see much in the log, I have run some test and there is a very weird behavior: If the word "fatal" is used in the prog, even commented, the compile file with illegal characters in path.

The program compiles fine with the following lines (extract, over 1420 lines):
Code
Select All
void update_error(int err) {
    Serial.print(F("CALLBACK:  HTTP update fatalx error code:"));
    Serial.println(err);
}
 


BUT NOT with
Code
Select All
void update_error(int err) {
    Serial.print(F("CALLBACK:  HTTP update fatal error code:"));
    Serial.println(err);
}
 



There is also another stange behavior: the compiler could not deal with function definitions positioned after their use at first go, then would work fine if I moved just one function definition for one compile (repositioning it after)???

Otherwise, compile time with SCons is down to 1min48.

Please advise on the issues highlighted.

Thanks in advance
BR

PS: I have tried with different encodings and it does not make a difference, if "fatal" is in the code, even commented, compile fails
« Last Edit: Jul 19th, 2024 at 9:52pm by ludo »  

Please Register or Login to the Forum to see File Attachments
Back to top
 
IP Logged
 
Tim@Visual Micro
Administrator
*****
Offline


Posts: 12186
Location: United Kingdom
Joined: Apr 10th, 2010
Re: failure to compile using SCons
Reply #16 - Jul 19th, 2024 at 10:06pm
Print Post  
we have released an update the reworks the cache of the GCC-E deep search. 1st build will run through all headers, subsequent builds will be fast. Please give it a try. 

GCC-E provides better arduino compatibility and the new release should make it fast enough that it runs through faster than SCons.

Thanks

Updated 29th July

We have released an update (24.0722.05). It resolves some path issues that was confusion between visual micro's, arduino 1x support and arduino 2x support. The compiler speed has also been improved.

The version is available from the visual micro downloads page or via the new releases section of this form. It will be pushed to the gallery over the next 48 hours. Releases
« Last Edit: Jul 29th, 2024 at 8:47pm by Tim@Visual Micro »  
Back to top
IP Logged
 
Page Index Toggle Pages: 1
Send TopicPrint